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Abstract 

The D0 experiment enjoyed a very successful data-collection run at the Fermilab 
Tevatron collider between 1992 and 1996. Since then, the detector has been upgraded 
to take advantage of improvements to the Tevatron and to enhance its physics 
capabilities. We describe the new elements of the detector, including the silicon 
microstrip tracker, central fiber tracker, solcnoidal magnet, preshower detectors, 
forward muon detector, and forward proton detector. The uranium/liquid- argon 
calorimeters and central muon detector, remaining from Run I, are discussed briefly. 
We also present the associated electronics, triggering, and data acquisition systems, 
along with the design and implementation of software specific to D0. 

Key words: Fermilab, DZero, DO, detector 
PACS: 29.30. Aj, 29.40.Mc, 29.40. Vj, 29.40.Gx 



1 Introduction 

The D0 experiment was proposed in 1983 to study proton- antiproton colli- 
sions at a center-of-mass energy of 1.8 TeV at the Fermilab Tevatron collider. 
The focus of the experiment was the study of high mass states and large px 
phenomena. The detector performed very well during Run I of the Tevatron, 
1992-1996, leading to the discovery of the top quark [1] and measurement 
of its mass [2,3,4,5,6], a precision measurement of the mass of the W boson 
[7,8,9,10,11,12,13], detailed analysis of gauge boson couplings [14,15,16,17,18,19,20,21,22], 
studies of jet production [23,24,25,26], and greatly improved limits on the 
production of new phenomena such as leptoquarks [27,28,29,30,31,32,33] and 
supersymmetric particles [34,35,36,37,38,39,40,41], among many other accom- 
plishments [42]. 
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During Rtiii I. the Tcvatron operated using six bunches each of protons and 
antiprotons, with 3500 ns between bunch crossings and a center-of-mass en- 
ergy of 1.8 TeV. The peak luminosity was typically 1-2x10^^ cm~^s~^ and 
approximately 120 pb~^ of data were recorded by D0. Following the com- 
pletion of the new Main Injector and associated Tevatron upgrades [43,44], 
the collider began running again in 2001. In Run II, which began in March 
2001, the Tevatron is operated with 36 bunches of protons and antiprotons 
with a bunch spacing of 396 ns and at an increased center-of-mass energy of 
1.96 TeV. The instantaneous luminosity will increase by more than a factor of 
ten to greater than 10^^ cm~^s~^ and more than 4 fb~^ of data are expected 
to be recorded. 

To take advantage of these improvements in the Tevatron and to enhance 
the physics reach of the experiment, we have significantly upgraded the D0 
detector. The detector consists of three major subsystems: central tracking 
detectors, uranium/liquid-argon calorimeters, and a muon spectrometer. The 
original D0 detector is described in detail in Ref. [45]. The central tracking 
system has been completely replaced. The old system lacked a magnetic field 
and suffered from radiation damage, and improved tracking technologies are 
now available. The new system includes a silicon microstrip tracker and a 
scintillating- fiber tracker located within a 2 T solenoidal magnet. The silicon 
microstrip tracker is able to identify displaced vertices for 6-quark tagging. 
The magnetic field enables measurement of the energy to momentum ratio 
(E/p) for electron identification and calorimeter calibration, opens new ca- 
pabilities for tau lepton identification and hadron spectroscopy, and allows 
precision muon momentum measurement. Between the solenoidal magnet and 
the central calorimeter and in front of the forward calorimeters, preshower 
detectors have been added for improved electron identification. In the forward 
muon system, proportional drift chambers have been replaced by mini drift 
tubes and trigger scintillation counters that can withstand the harsh radiation 
environment and additional shielding has been added. In the central region, 
scintillation counters have been added for improved muon triggering. We have 
also added a forward proton detector for the study of diffractive physics. A 
side view of the upgraded D0 detector is shown in Figure 1. 

The large reduction in the bunch spacing required the improvement of the 
read-out electronics and the implementation of pipelining for the front-end 
signals from the tracking, calorimeter, and muon systems. The calorimeter 
preamplifiers and signal-shaping electronics have been replaced, as have all of 
the electronics for the muon system. The trigger system has been significantly 
upgraded, providing three full trigger levels to cope with the higher collision 
rate and new hardware to identify displaced secondary vertices for 6-quark 
tagging. Muon triggering has been enhanced by the addition of scintillation 
counters in the central and forward regions. 
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Fig. 1. Diagram of tlie upgraded D0 detector, as installed in the collision hall and 
viewed from inside the Tevatron ring. The forward proton detector is not shown. 
The detectors in the central region of the detector are shown in Fig. 2. 



A significant improvement to the detector's performance resulted from the 
removal of the old Main Ring beam pipe from the calorimeters. During Run I, 
the Main Ring was used to accelerate protons for antiproton production while 
the Tevatron operated in collider mode. Losses from the Main Ring produced 
spurious energy deposits in the calorimeters and muon system, and most trig- 
gers were not accepted while Main Ring protons passed through the detector. 
Removal of the Main Ring increased the livetime of the detector by approxi- 
mately 10%, depending on the trigger. 

In the following sections of this paper, we describe the design and performance 
of the upgraded D0 detector. The new central tracking system and solenoidal 
magnet are presented in Sections 2 and 3, respectively. The preshower de- 
tectors are described in Section 4. The calorimeters are briefly described in 
Section 5 along with the new calorimeter electronics. The muon system is 
discussed in Section 6. The new forward proton detector is presented in Sec- 
tion 7. The luminosity monitor is described in Section 8. The triggering and 
data acquisition systems are described in Sections 9 and 10. Section 11 covers 
detector controls and monitoring and Section 12 contains an overview of the 
software components of the experiment. 
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In the detector description and data analysis, we use a right-handed coordinate 
system in which the 2;-axis is along the proton direction and the y-axis is 
upward (Figure 1). The angles 4> and 9 arc the azimuthal and polar angles, 
respectively. The r coordinate denotes the perpendicular distance from the z 
axis. The pseudorapidity, r) — — ln[tan(^/2)], approximates the true rapidity, 
y = 1/2 \n[{E+pzc)/{E—pzc)], for finite angles in the limit that (mc^/E) — > 0. 
We use the term "forward" to describe the regions at large |77|. 



2 Central tracking 

Excellent tracking in the central region is necessary for studies of top quark, 
electroweak, and b physics and to search for new phenomena, including the 
Higgs boson. The central tracking system consists of the silicon microstrip 
tracker (SMT) and the central fiber tracker (CFT) surrounded by a solenoidal 
magnet. It surrounds the D0 beryllium beam pipe, which has a wall thickness 
of 0.508 mm and an outer diameter of 38.1 mm, and is 2.37 m long. The two 
tracking detectors locate the primary interaction vertex with a resolution of 
about 35 iim along the beamline. They can tag 6-quark jets with an impact 
parameter resolution of better than 15 /im in r — for particles with transverse 
momentum px > 10 GeV/c at \r}\ — 0. The high resolution of the vertex 
position allows good measurement of lepton pt, jet transverse energy {Et) , and 
missing transverse energy ^j.. Calibration of the electromagnetic calorimeter 
using E/p for electrons is now possible. 

Both the SMT and CFT provide tracking information to the trigger. The SMT 
provides signals to the Level 2 and 3 trigger systems and is used to trigger on 
displaced vertices from 6-quark decay. The CFT provides a fast and continuous 
readout of discriminator signals to the Level 1 trigger system; upon a Level 1 
trigger accept, track information based on these signals is sent to Level 2. The 
Level 3 trigger receives a slower readout of the CFT's digitized analog signals, 
in addition to the discriminator information available at Level 1 and Level 2. 

A schematic view of the central tracking system is shown in Figure 2. 
2.1 Silicon microstrip tracker 

The SMT provides both tracking and vertexing over nearly the full rj coverage 

of the calorimeter and muon systems. Design of the detector, electronics, and 
cooling are, in large part, dictated by the accelerator environment. The length 
of the interaction region (a ~ 25 cm) sets the length scale of the device. With 
a long interaction region, it is a challenge to deploy detectors such that the 
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Fig. 2. Cross-sectional view of the new central tracking system in the x — z plane. 
Also shown are the locations of the solenoid, the preshower detectors, luminosity 
monitor, and the calorimeters. 



tracks are generally perpendicular to detector surfaces for all 77. This led us to a 
design of barrel modules interspersed with disks in the center and assemblies 
of disks in the forward regions. The barrel detectors primarily measure the 
r — coordinate and the disk detectors measure r — z as well as r — 0. Thus 
vertices for particles at high r\ are reconstructed in three dimensions by the 
disks, and vertices of particles at small values of r\ are measured in the barrels 
and central fiber tracker. This design poses difficult mechanical challenges in 
arranging the detector components and minimizing dead areas while providing 
sufficient space for cooling and cables. 

An isometric view of the SMT is shown in Figure 3. The detector has six 
barrels in the central region. Each barrel has four silicon readout layers. The 
silicon modules installed in the barrels arc called "ladders." Layers 1 and 
2 have twelve ladders each; layers 3 and 4 have twenty-four ladders each, 
for a total of 432 ladders. Each barrel is capped at high \z\ with a disk of 
twelve double-sided wedge detectors, called an "F-disk." Forward of the three 
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Fig. 3. The disk/barrel design of the silicon microstrip tracker. 

disk/barrel assemblies on each side is a unit consisting of three F-disks. In the 
far forward regions, two large-diameter disks, "H-disks," provide tracking at 
high Twenty-four full wedges, each consisting of two back-to- back single- 
sided "half" wedges, are mounted on each H-disk. There are 144 F-wedges 
and 96 full H-wcdgcs in the tracker; each side of a wedge (upstream and 
downstream) is read out independently. There is a grand total of 912 readout 
modules, with 792,576 channels. The centers of the H-disks are located at 
1^1 = 100.4, 121.0 cm; the F-disks are at \z\ = 12.5, 25.3, 38.2, 43.1, 48.1, 
and 53.1 cm. The centers of the barrels are at \z\ — 6.2, 19.0, 31.8 cm. The 
SMT is read out by custom-made 128-channel SVXIIe readout chips. 

2.1.1 Sensors 

2.1.1.1 Sensor types The SMT uses a combination of single-sided (SS), 
double-sided (DS), and double-sided double- metal (DSDM) technologies. Sil- 
icon sensors were obtained from three manufacturers. All barrel sensors were 
produced by Micron Semiconductor LTD [46] . The wedges for the F-disks were 
produced by Micron Semiconductor LTD and Canberra Eurisys Mesures [47] . 
The wedge sensors for the H-disks were manufactiucd by ELMA [48]; these 
sensors use intermediate strips for charge interpolation. Single-sided and double- 
sided devices were produced from high resistivity 4" silicon wafers, with crystal 
orientation <111> and <100>. The 90° stereo sensors used in layers 1 and 3 
of the four centermost barrels are DSDM sensors, manufactured using <100> 
6" wafers. Isolation on the n-side of all double-sided sensors is provided by p- 
stop implants. All traces are biased using polysilicon resistors. Table 1 shows 
the sensor types used in the SMT and their locations. 

Disk sensors are trapezoids with readout strips arranged parallel to the long 
edge of the devices. This provides an effective 30° stereo angle for the double- 
sided F-disks. A wedge for the H-disks consists of a pair of single-sided half- 
wedges mounted back-to-back, giving an effective stereo angle of 15°. This 
arrangement means that the strip length varies for strips which originate past 
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Table 1 

Characteristics and deployment of various sensor types in the SMT. i indicates the 
length of the inner H-disk sensor; o is the length of the outer H-disk sensor. 



Module 


Type 


Layer 


Pitch (//m) 
p/n 


Length 
(cm) 


Inner 

radius 
(cm) 


Outer 

radius 
(cm) 


F-disks 


DS 




50/62.5 


7.93 


2.57 


9.96 


H-disks 


ss 




40 

80 readout 


7.63' 
6.33° 


9.5 


26 


Central 


DSDM 


1. 3 


50/153.5 


12.0 


2.715 


7.582 


barrels (4) 


DS 


2,4 


50/62.5 


6.0 


4.55 


10.51 


Outer 


SS 


1,3 


50 


6.0 


2.715 


7.582 


barrels (2) 


DS 


2,4 


50/62.5 


6.0 


4.55 


10.51 



the base of the trapezoid. There are three types of sensors in the central barrels. 
The second and fourth layers use double-sided stereo sensors with the n-side 
implants at a 2° angle with respect to the p-side axial strips. Two of these 
sensors are bonded together to form a 12-cm-long ladder. The first and third 
layers of the outer barrels use single-sided sensors with axial strips and, again, 
two sensors are bonded together to make one 12-cm ladder. The inner four 
barrels use single 12-cm-long 90° stereo sensors. Ninety degree readout was 
achieved by using a second metal layer on the n-sidc insulated from the first 
metal by 3 /xm of PECVD (plasma enhanced chemical vapor deposition) silicon 
oxide. Two readout strips on this side are multiplexed to a single readout 
channel. Implants on the n-side are isolated by individual p-stop frames in 
addition to a common p-stop enclosure. 



2.1.1.2 Sensor testing All sensors were required to exhibit leakage cur- 
rent below 260 nA/cm^, and each channel was tested for leakage current, AC 
coupling capacitance, and AC coupling leakage to 80 V. The AC coupling 
leakage test is especially important for the double-sided sensors since these 
capacitors are required to stand off the depletion voltage. Several classes of 
problems were identified during the testing: 

• Areas of low interstrip resistance — Washing bad sensors in pure water at 
the vendor sometimes cured this problem. 

• Isolation-implant shorts — These occur in all sensor types but the effects 
are particularly severe in the DSDM sensors where a single isolation short 
can affect a region of approximately twenty channels. Strip-by-strip DC 
scans were performed at the manufacturer to identify problems early in 
processing. 
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Fig. 4. Depletion voltage as a function of fluence as measured for SMT modules in 
the Fermilab Booster. 



• Poorly controlled bias resistance — Sensors with bias resistors as high as 
10 Mf2 (5x nominal) were eventually accepted. 

• Micro discharge breakdown — This breakdown was observed with modest 
negative voltage applied to the p-side of double-sided sensors. The onset 
voltage of breakdown was measured for each sensor and used to set the 
split between p(— )- and n(+)-side bias voltage. 



2.1.1.3 Radiation damage studies A set of radiation damage qualifica- 
tion studies was performed at the Fermilab Booster and the Radiation Labora- 
tory at the University of Massachusetts Lowell. In general, the results of these 
studies conformed to behavior expected from RD48 [49] parameterizations. 
The exception was the depletion voltage (V^) behavior of the DSDM devices, 
shown in Figure 4. These sensors exhibit a rise in depletion voltage almost 
twice as fast as that of the single-sided sensors. To determine if the anoma- 
lous behavior is due to the bulk silicon properties, photodiode test structures 
from the same wafer were irradiated in the booster. These all showed normal 
behavior. It is likely that the rapid rise in depletion voltage is related to the 
PECVD inter-metal isolation layer. 

Microdischarge breakdown is caused by large fields near the junction implant. 
This high-field region is expected to move with the junction from the p-side to 
the n-side upon type inversion. In addition, fixed positive charge in the oxide 
insulation layers will tend to increase the field on the p-side and reduce it on 
the n-side. This is indeed what we observe. Breakdown moves from the p-side 
to the n-side after type inversion and the threshold increases to approximately 
150 V after about 2 Mrad. Microdischarge in the DSDM sensors will limit the 
lifetime of the SMT to an integrated luminosity of 3.5-6 fb~^. 
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Fig. 5. Double-sided ladder design, n-side. The SVXIIe readout chips shown as 
dashed lines are located on the p-side of the ladder. 

2.1.2 Mechanical design 

2.1.2.1 Ladders Sensor ladder assemblies were designed for low mass, pre- 
cise alignment, and good thermal performance. With the exception of the 
DSDM ladders, which use a single 12-cm sensor, ladders were constructed us- 
ing two 6-cm sensors. All ladder assembly was done under the control of a 
coordinate measuring machine (CMM). The two sensors were aligned using 
the fiducials on the sensors. Alignment was achieved during assembly using 
locating notches in precisely machined beryllium pieces on both the "active" 
(SVXIIe- readout-chip carrying, see Section 2.1.3) and "passive" sides of the 
ladder. These notches correspond to posts on the support bulkheads and are 
aligned to fiducials on the sensor. Carbon-boron fiber/Rohacell rails bridge 
the beryllium pieces and maintain the flatness of the ladder assemblies. 

A sketch of a double-sided 2° ladder with nine SVXIIe readout chips is shown 
in Figure 5. Figure 6 shows a similar ladder on an assembly fixture with 
the high density interconnect (HDI, Section 2.1.3) unfolded, spring-loaded 
"pushers," and support rails. Each ladder and wedge was surveyed using an 
automatic optical CMM after assembly. 

2.1.2.2 Wedges In contrast to the barrel assemblies, F- and H-disks are 
planar modules, allowing for simple optical alignment during assembly. A 
major design constraint was to provide minimum dead space between the 
disk/barrel assemblies. F- wedges use double-sided sensors with separate 8- 
and 6-chip HDIs for each side. The larger strip pitch (62.5 /xm vs 50 /xm) 
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Fig. 6. Double-sided ladder during assembly with the flex hybrid unfolded. The 
spring-loaded "pushers" and support rails are also visible. 

on the n-side requires an adapter to match the SVXIIe readout pitch. The 
50 yum-thick copper-clad Kapton [50] pitch adaptors are part of the cooling 
path to the p-side and allow the six n-side SVXIIe chips to be located out- 
board of the cooling channel. The double-sided hybrid assembly required a 
complex 12- layer vacuum lamination with pitch adaptor, Tedlar [51], Ablefilm 
adhesive [52], Kapton [50], beryllium, and HDI layers. 

H-disk wedges are made from back-to-back single-sided sensors. In this case, 
the precise front-to-back alignment was provided in the wedge assembly pro- 
cess. A special dual-camera assembly fixture was developed to simultaneously 
image fiducials on the top and bottom sensors. This allowed front-to-back 
alignment of the two-sensor wedges of better than 15 fim. An aluminized sil- 
icon pitch adapter, fabricated on the same wafer as the sensor, was used to 
match the 80 /im readout pitch to the SVXIIe input. 



2.1.2.3 Supports and assembly Barrel ladders are supported by beryl- 
lium bulkheads machined with posts and pinholes for ladder support. Each 
barrel has a thick "active" bulkhead containing the cooling channels and con- 
nections to the outer support cylinder, and a thin "passive" bulkhead that 
serves to set the spacing of the ends of the ladders without readout chips. 
Ladders were lowered onto the posts using a special insertion fixture and fixed 
into place with pins. Thermal contact to the cooled bulkhead edge is made 
with thermal grease. Each ladder is grounded to the bulkheads with conduct- 
ing epoxy. Edges of the beryllium pieces were measured with the touch probe 
of the assembly CMM, and these measurements were correlated to the beryl- 
lium and sensor fiducial mark measurements taken with the optical CMM to 
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Fig. 7. Cross section of the SMT disk/barrel module showing ladders mounted on 
the beryllium bulkhead, sample cable paths, three of twelve F-disk wedges, carbon 
fiber support structure, and the low-mass cable stack. 

provide the final ladder position. Cables (HDI "tails") are routed between 
barrel sublayers inboard of ladders, so no inter-module space is taken by the 
HDI tails. The tails are coupled to "card edge" style Hirose connectors [53] 
on the low-mass, flexible, Kapton cables on the outer surface of the support 
structure. 

Disks are supported by beryllium rings. Wedges are located on alternate sides 
of the ring with sufficient overlap to eliminate dead regions. Wedges were 
manually aligned under a CMM and secured with screws. Finished F-disks 
were then assembled into a disk/barrel central module or one of the three-disk 
modules at the end of the central disk/barrel section. 

Overall support of the SMT (exclusive of the H-disks) is provided by two 
double-walled carbon fiber cylinders spaced by carbon fiber ribs to eliminate 
differential contraction. North and south half- cylinders are independent struc- 
tures. This limits the size of the units, allowing installation of the SMT in 
the limited space available in the collision hall. The central upper section of 
each half-cylinder is removed for placement of the disk/barrel modules. Each 
module is supported by adjustable kinematic mounts. Cables and services are 
accessed through holes in the cylinder whose outer surface is used for routing 
the low-mass cables and water manifolds. Final alignment is provided by sap- 
phire balls mounted on the bulkheads, which are accessed with touch probes 
through additional holes in the support cylinder. The disk/barrel half cylin- 
ders are supported from the inner central fiber tracker barrel using mounts 
glued into place. Figure 7 shows the disk/barrel module within its support 
cylinder. H-disks are located on separate mounts suspended from the third 
layer of the CFT. 
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2.1.2.4 Cooling The maximum operating temperature of the detector is 
hmited to reduce bulk damage to the sihcon. which leads to type inversion 
and increasing depletion voltage. Heat generated by the SVXlIe chips must 
flow through the HDl, epoxy, beryllium heat spreaders, and, for the top-side 
chips, through the silicon and the bottom-side readout structure. 

Coolant is a water/30% ethylene glycol mixture supplied at —10° C by two 
redundant 4.4 kW chillers. The coolant flows through channels machined in 
the active beryllium bulkheads and ring supports and is maintained below 
atmospheric pressure to minimize the effect of any possible leaks. Pressure 
drop across detector elements is below 5 psi with a temperature rise in the 
channel of 1-1.5° C. A manifold is used for each side of the half-cylinder with 
flows through the modules controlled by restricting apertures. The hottest 
point of the silicon at the tip of the ladder is typically 10-15° C above the 
coolant temperature, maintaining the silicon temperature below 5° C. 

2.1.3 Electronics 

2.1.3.1 SVXIIe chip and HDIs The SMT is read out using the 128- 
channel SVXlle chip [54]. The chip includes preamp, analog delay, digitization, 
and data sparsiflcation. Input charge is integrated on the preamplifler for a 
train of beam crossings (typically twelve) and reset during inter-bunch gaps. 
This charge is delivered to a 32-cell analog pipeline. Upon a Level 1 trigger 
accept, double-correlated sampling is performed on the appropriate cells ^ and 
this analog information is fed to a parallel set of Wilkinson ADCs. Digitization 
utilizes both edges of the 53 MHz main accelerator clock, providing 8 bits of 
analog information in 2.4 //s. Readout is half as fast. Typical noise performance 
for a rise time setting of 100 ns is 490e -|- 50e/pF. Fabrication was done using 
the 1.2 fjLm UTMC radiation-hard process [55] with yields of approximately 
60%. 

To make the HDIs, chips were mounted on Kapton flex circuits laminated 
to beryllium heat spreaders. Eight different types of HDI are necessary to 
accommodate the various detector and readout geometries. A readout cable 
"tail" is part of each HDI. In the case of double-sided ladders, a single HDI 
contains the readout for both the p- and n-sides with the Kapton folded over 
to sandwich the ladder. The ffex circuits are two-layer 50 /im Kapton with 
125 /im line spacing and 50 /im plated-through holes. 

2.1.3.2 Readout Figure 8 shows the SMT readout chain. Trigger infor- 
mation is received via the serial command link (SCL) by the sequencer crate 

^ Double correlated sampling is the process of subtracting the analog baseline 
pedestal value from the value being measured. 
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Fig. 8. Diagram of the major components of the SMT readout system. The data 
acquisition (DAQ) system is discussed in detail in Section 10. The horse shoe, cathe- 
dral, platform, MCH2, and MCH3 are places where various pieces of electronics are 
located. 

controller. The SVXIIe sequencer provides timing and control signals for the 
SVXIIc chips on eight HDIs. These signals arc regenerated by interface boards 
that also control power and bias for the SVXIIe chips and provide interfaces 
to the monitoring systems and individual HDI temperature and current trips. 

Data from the ladders and wedges are sent from the sequencers to VME read- 
out buffer (VRB) memories via optical link fibers. The VRBC (VRB con- 
troller) receives trigger data from the SCL and uses that information to control 
the operation of the VRBs. Two single-board computers are resident in each 
readout crate. The primary purpose of the Power PC is slow monitoring and 
calibration. The second computer (SBC) collects data from the VRBs upon 
Level 2 accepts and then sends the data to Level 3 for readout. Downloads 
and slow controls are provided by a MIL-STD-1553B [56] control system. 



2.1.3.3 Cabling Clock, power, and signal quality and timing are critical 
to proper operation of the SVXIIe chip. The SMT is read out using low-mass, 
flexible, Kapton cables within the detector volume followed by high-mass 80- 
and 50-conductor "pleated-foil" cables on the outside. The cables carry both 
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power (except the 50-conductor high-mass cables) and digital signals. A pair of 
coaxial cables carries the differential clock. Low-mass cables are routed along 
the half cylinder and coupled to the 80-conductor pleated-foil cables at a ring 
of adapter cards mounted on the end of the central calorimeter cryostat. 



2.1.4 Production and testing 

Production of ladders and wedges and assembly into barrels and disks were 
performed at the Sihcon Detector Facihty (SiDet) at Fermilab; the work took 
slightly more than one year. Components such as chips, HDIs, and cables were 
tested before shipment to Fermilab. A number of sensor- and HDI-rclated 
problems were identified that necessitated extensive quality control testing. 
Tests included: 

• HDI burn-in — Each HDI was operated at room temperature for 24 hours. 

Current, pedestal, and gain were monitored. 

• Ladder/wedge debugging — Pedestal and noise were measured for each as- 
sembled module. Pinholes (shorted AC coupling capacitors) generated in 
the wirebonding process were identified in 0.8% of the channels and the 
associated wirebonds pulled. The onset voltage for microdischarge was de- 
termined on the n-side of double-sided sensors. Resistance between the HDI 
ground and beryllium was measured. Grounds were remade if the resistance 
was greater than 10 ^2. 

• Ladder/ wedge burn- in — Assembled and tested ladders and wedges were 
operated at 5° C for 72 hours. Currents, pedestals, gain, data integrity, and 
noise were monitored. 

• Laser test — Modules were tested using a 1064 nm laser on a computer- 
controlled X — y table. This test allowed us to measure depletion voltage 
and tabulate broken and noisy channels. 

• Assembly test — Noise and readout were tested for each ladder (wedge) 
as it was installed in a barrel (disk). Coherent noise was evident in badly 
grounded ladders and grounds were remade. 

• Final cabling test — Readout was verified after the low-mass cables were 
attached. Upon leaving SiDet, 99.5% of the sensors were functional. 

This extensive testing was made possible by the development of a "Stand 
Alone Sequencer" (SASEQ), a 3U VME module which could be read out 
simply using a PC- VME interface and Microsoft EXCEL. This allowed for 
easy replication of testing systems at Fermilab and universities. 

A large scale "10%" test was organized to test major detector components 
with pre-production versions of final readout components. This test was crucial 
for debugging readout hardware, testing termination schemes, and adjusting 
sequencer timings. Features were identified in the SVXIIe chip that caused 
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pedestal jumps and readout errors. Additional initialization states were added 
to the SVXIIe control sequence to address these problems. An assembled barrel 
and F- and H-disks were tested in the 10% test to check system integration 
and search for noise problems. Cosmic ray data were taken with the barrel as 
a final check of system performance. 

2.1.5 Operation 

2.1.5.1 Operating experience The SMT has been included in physics 

data taking since the start of Run II. Full electronics debugging was completed 
in October 2001, when 94% of the sensors were functional. As of May 2005, 
90% of sensors were functional (note that problems can be anywhere along 
the readout chain). Most operational difficulties have been peripheral to the 
silicon detector itself. These include latchup of operational amplifiers on the 
interface boards, low voltage power supply failures, and high leakage currents 
in high voltage distribution boxes. 

The most serious detector feature is "grassy noise," shown in Figure 9, which is 
confined to the Micron-supplied F-disk detectors (75% of the F-disk sensors). 
This noise is characterized by large charge spikes which cover 10-20 strips and 
occur in about 20% of the events for affected devices. Leakage currents typi- 
cally rise to greater than 100 //A within one hour of turn-on at the beginning 
of a store. Both the SMT and CFT observe pedestal shifts that depend on 
the phase of the beam crossing with respect to the SVXIIe reset pulse. These 
shifts are typically 1-2 counts (27 counts/MIP) in most ladders but can be as 
large as 10 counts in a few that presumably have poor ground connections. 
Digital voltage supply current in the SVXIIe chip rises steadily if the chip 
is not properly initialized or not read out steadily and can cause individual 
HDIs to trip off in 5-10 minutes. These currents are constantly displayed and 
a special pulser is turned on if there is an extended interruption in data taking. 



2.1.5.2 Alignment and calibration Signal/noise performance varies with 
detector type from 12:1 to 18:1. Coherent noise is typically one-third of the 
random noise but varies due to the crossing-dependent pedestal shifts de- 
scribed in Section 2.1.5.1. Gains vary among detector types with the n-sides 
5-15% lower than the p-sides due to the larger load capacitance. Pulse height 
information from the SVXIIe is used to calculate cluster centroids and can 
also be used for dE/dx tagging of low momentum tracks. Figure 10 shows 
dE/dx distributions after corrections for gain and incident angle are made. 

Detector alignment was transferred from optical CMM measurements of de- 
tector fiducials to ladder beryllium features to barrel sapphire balls to half- 
cylinder targets to the D0 coordinate system. Final ahgnment for the com- 
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Fig. 9. Example of the grassy noise seen in the Micron-supphed F-disk detectors. 
Ideally, the entire plot would look like the region above channel 800. 
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Fig. 10. Distribution of energy loss for a kaon-enriched sample of tracks showing vr, 
K, and proton bands. 

bined SMT-CFT tracking system is better than 10 /zm (Figure 11). 



2.2 Central fiber tracker 



The CFT consists of scintillating fibers mounted on eight concentric support 
cylinders and occupies the radial space from 20 to 52 cm from the center of 
the beampipe. To accomodate the forward SMT H-disks, the two innermost 
cylinders are 1.66 m long; the outer six cylinders are 2.52 m long. The outer 
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Fig. 11. Axial residual distribution using tracks with px > 3 GeV/c (a) upon initial 
installation and (b) after software alignment of the central barrel detectors. The 
residual is the distance between the SMT hit and the track. The track fit was 
done using all SMT and CFT hits except the SMT hit in question. The simulated 
resolution of the residual distribution for a perfectly aligned detector is about 16 /xm. 



cylinder provides coverage for |?7| < 1.7. Each cylinder supports one doublet 
layer of fibers oriented along the beam direction {z) and a second doublet layer 
at a stereo angle in (p of +3° (n) or —3° (v). Doublet layers with fibers oriented 
along the beam axis are referred to as axial layers, while the doublet layers 
oriented at small angles are referred to as stereo layers. From the smallest 
cylinder outward, the fiber doublet orientation is zu — zv — zu — zv — zu — 
zv — zu — zv. The scintillating fibers are coupled to clear fiber waveguides 
which carry the scintillation light to visible light photon counters (VLPCs, 
Section 2.2.4) for read out. The small fiber diameter (835 /zm) gives the CFT 
an inherent doublet layer resolution of about 100 /im as long as the location 
of the individual fibers is known to better than 50 fim. Scintillating fiber 
detectors are discussed in detail in Ref. [57]. 

Discriminator signals from the axial doublet layers are used to form a fast 
Level 1 hardware trigger based upon the number of track candidates above 
specified pt thresholds (with a minimum threshold of 1.5 GeV/c). Level 1 
track candidates are used by the Level 2 trigger, while the Level 3 trigger uses 
the full CFT readout information. 
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2.2.1 Fibers 



The scintillating fibers, including the cladding, are 835 /xm in diameter and 
1.66 or 2.52 m in length. They are optically connected to clear fiber waveguides 
of identical diameter which are 7.8 to 11.9 m long. The fibers were manufac- 
tured by Kuraray [58] and have a multi-clad structure consisting of a core 
surrounded by two claddings. The scintillating fiber is structurally and chem- 
ically similar to the clear fiber, but contains fiuorescent dyes. The CFT uses 
about 200 km of scintillating fiber and 800 km of clear fiber. 

Light production in the fibers is a multistep process. The base core mate- 
rial is polystyrene (PS). The PS is doped with the organic fluorescent dye 
paraterphenyl (pT) to about 1% by weight. Excitations in the PS are rapidly 
transferred to the pT via a non-radiative dipole-dipole interaction. pT has a 
rapid fluorescence decay (a few nanoseconds) and a short emission wavelength 
(?» 340 nm). The mean free path of the emitted light is only a few hundred mi- 
crons in the PS. To get the light out of the detector, a secondary wave-shifter 
dye, 3-hydroxyflavone (3HF), is added at a low concentration (1500 ppm). The 
3HF is spectrally matched to the pT but has minimal optical self-absorption. 
The 3HF absorbs the 340 nm radiation from the pT and re-emits it at 530 nm 
which is well-transmitted in PS. 

Surrounding the PS core, whose refractive index is n = 1.59, are two claddings, 
each approximately 25 /xm thick: an inner layer of polymethylmethacrylate 
(PMMA) with n — 1.49, and an outer layer of fluoro-acrylic with n — 1.42. 
The PMMA inner cladding serves as a mechanical interface between the core 
and the outer cladding, which are mechanically incompatible. The multiclad 
flber is both mechanically and optically superior to single-clad flber and typical 
values of the attenuation length are about 5 m for the scintillating flber and 
about 8 m for the clear flber. 

We observe the light from only one end of each scintillating flber. The opposite 
end of each of the scintillating flbers was mirrored with a sputtered aluminum 
coating that provides a reflectivity of about 90%. 

The scintillating flbers were assembled into ribbons consisting of 256 flbers in 
two layers of 128 flbers each. Precisely spaced grooves were machined into a 
long, l/16"-thick piece of acetal. The spacing between the grooves varies be- 
tween 928 and 993 /im and depends on the radius of the corresponding support 
cylinder. The grooved plastic was inserted into a rigid, curved backing plate of 
the desired radius, and the scintillating flbers were laid in and glued together 
to form the doublet ribbons; the two layers of flber are offset by one-half of 
the flber spacing. The technique is illustrated in Figure 12. It enables curved 
ribbons to match the curvature of each support cylinder without machining 
precisely-spaced grooves into a curved surface. Details on flber lengths and 
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Fig. 12. Technique for curved scintillating fiber ribbon fabrication. 
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Design parameters of the CFT; u = 
eight axial layers of the CFT. 
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spacings are provided in Table 2. 



The readout ends of the fibers were carefully positioned and adhesively bonded 
into v-groove connectors, which are located around the outer perimeter of the 

detector, and then the mass-terminated ribbon and connector were polished 
to facilitate high efficiency light transmission across the connector joint. A 
polished curved connector is shown in Figure 13. Each 256-fiber waveguide 
bundle terminates in a matching curved connector. The connectors for each 
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Fig. 13. A CFT fiber ribbon mass terminated via a v-groove connector. 

doublet fiber layer are different since the connectors must have the proper cur- 
vature for each layer. The light transmission through the v-groove connectors, 
with optical grease between the fiber ends, is approximately 95%. 

After the fiber ribbons were fabricated, a ^^Co x-ray source was used to ver- 
ify the accuracy of the fiber placement, the responses of the fibers, and the 
transmission efficiency of the connectors. The position of each fiber within a 
ribbon was determined with an accuracy of better than 25 /im rms. 

2.2.2 Mechanical support structure 

The eight support cylinders are each double-walled with a 0.25"-thick core of 
Rohacell [59] . The walls are constructed from linear carbon fibers impregnated 
with about 40% resin. To minimize sagging of the cylinders, the carbon fibers 
were applied in layers in the following pattern: 0°/60°/— 60°/core/— 60°/60°/0° 
where the angles are those of the carbon fibers with respect to the axis of the 
cylinder. Each carbon fiber layer is about 0.0025" thick; the total thickness 
of carbon per cylinder is 0.020". After fabrication, the outside diameters of 
the cylinders were measured and compared to a perfect cylinder. The radial 
deviation for all cylinders is approximately 100 fim rms. 

The requirements of the Level 1 hardware trigger constrain the design of the 
CFT, particularly in the placement of the scintillating fiber ribbons. Offline 
reconstruction of the CFT data can incorporate corrections for misalignment 
of fibers, but this is not possible in the hardware trigger; the axial fibers 
had to be placed on the support cylinders such that any skew from parallel 
to the beam axis is less than 200 fim from end to end. Consequently, the 
individual fiber ribbons were precisely positioned and bonded to the outer 
surface of each cylinder prior to nesting the cylinders. The placement precision 
is approximately 35 fim rms for both axial and stereo layers. The connectors 
for the axial ribbons are all on one end of the cylinder, while the connectors for 
the corresponding stereo ribbons are all on the opposite end of the cylinder. 

Successive cylinders are nested together by thin carbon-fiber annular rings 
that connect the inner surface of the end ring of one cylinder to a carbon-fiber 
ring mounted on the outer fiber surface of the cylinder immediately inside. 
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The fiber connectors and interlocking rings seal the fiber volume. 

For tracks traversing the detector at normal incidence, the thickness of each 
cyhnder can be described as follows: 0.28% of a radiation length for the scin- 
tillating fibers, 0.32% for the carbon fiber support cylinder, 0.13% for the glue 
used to make ribbons out of fibers, and 0.17% for the glue used to attach the 
ribbons to the support cylinders. 

2.2.3 Waveguides 

The clear fiber waveguides range in length from 7.8 to 11.9 m, and use the 
clear fibers described in Section 2.2.1. The waveguides generally contain 256 
clear fibers inside a fiexible protective plastic light shield. One end is mass ter- 
minated in a curved acetal connector machined to mate to the corresponding 
connector at the end of the scintillating fiber ribbon. The mass-terminated 
curved connector end was polished using a diamond fiy cutter. About 40 cm 
from the other end of the waveguide, the 256 fibers are separated in into two 
groups of 128 fibers. Each group is covered with a flexible plastic protective 
light shield. These fibers are individually routed into the appropriate locations 
in two rectangular connectors that are designed to mate to the VLPC cassettes 
(Section 2.2.4). These molded plastic rectangular connectors are composed of 
Noryl N190 [60] with Celogen RA foam [61] to minimize distortions. After 
the fibers were potted into the rectangular connectors, the fiber-connector 
assembly was polished and the routing of the fibers was verified. 

The clear fiber waveguides are routed from the ends of the CFT through the 
small gaps between the central and end calorimeter cryostats to the VLPC 
cassettes located about 6 m below the central calorimeter cryostat. These gaps 
also contain the forward preshower detectors (Section 4.3), the waveguides for 
the forward and central (Section 4.2) preshower detectors, and the readout 
cables for the SMT. The narrowest region, between the forward preshower 
detector and the solenoidal magnet, is about 1.5" wide in z, requiring the 
waveguides to follow complex paths along the central calorimeter cryostat. 
Moreover, the waveguide bundles must have the correct lengths to provide the 
proper timing for signals at the VLPCs. The waveguide routing is illustrated 
in Figure 14. 

2.2.4 Visible light photon counter cassettes 

The light generated by the passage of charged particles through the scintil- 
lating fibers of the CFT is converted into electrical signals by the VLPCs 
housed in the VLPC cassettes. VLPCs arc impurity-band silicon avalanche 
photodetectors that operate nominally at 9 K, and are capable of detecting 
single photons [62,63]. They provide fast response, excellent quantum efficiency 
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Fig. 14. Routing of the clear waveguide fibers on the south face of the central 
cryostat. 

(>75%), high gain (22,000 to 65,000), low gain dispersion, and the capability 
of functioning in a high background environment. 



VLPCs are fabricated by growing a series of doped and undoped silicon layers 
on silicon substrate wafers. Individual wafers yield a maximum of 176 VLPC 
chips after dicing, and each chip contains a two by four array of 1-mm-diameter 
pixels. Each eight-pixel chip is soldered to an aluminum nitride substrate, and 
the outputs from individual pixels are wirebonded to individual contact pads 
on the substrate. Non-uniformities in the production process result in vari- 
ations in characteristics such as gain, quantum efficiency, and thermal noise 
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rates among and across VLPC wafers [64]. Due to these variations, the bias 
voltage at which the VLPCs operate at optimal signal-to-noise ratio varies be- 
tween 6 and 8 volts. To reduce the complexity of the bias voltage and thresh- 
old implementations in the readout electronics, the VLPC chips are carefully 
sorted and assigned to specific cassettes to allow for optimal performance. 

VLPC cassettes mounted in cryostat slots provide the mechanical support, 
optical alignment, and appropriate operating environment for the VLPCs. 
Figure 15 shows an outside view of a cassette with a readout board attached. 
Each VLPC cassette houses 128 VLPC chips, and thus provides 1024 individ- 
ual pixels of light-sensitive detector. Details of the specially-designed VLPC 
cryostats are available in Ref. [65]. Cassettes are approximately 88 cm tall, 
48 cm wide, and 4.4 cm thick. Individual 0.965-mm-diameter fibers inside each 
cassette guide light from the clear fiber waveguides to individual VLPC pixels, 
and fiex circuits provide paths for the electrical signals from the VLPCs to the 
preamplifiers on the analog front-end boards (AFEs) that are mounted on the 
cassette body. In addition to preamplifiers, the AFEs also provide trigger dis- 
criminator signals, temperature control, and bias-voltage control electronics. 
Details on the AFEs are provided in Section 2.2.5. 

Each VLPC cassette consists of a cassette body housing eight modules. A view 
of the internal structure of a partially assembled cassette is shown in Figure 16. 
Each module is composed of a 128-fiber bundle and a cold-end assembly. The 
cassettes are designed so that modules can be readily extracted to allow repair 
of the cold-end assemblies. The 128-fiber bundle terminates at the top end in 
a rectangular molded optical connector (referred to as the warm-end optical 
connector), and at the bottom (cold) end in sixteen groups of eight fibers. The 
ends of the fibers are polished, and each group of eight fibers is glued into a 
molded plug. The plugs and mating boxes are precision-molded parts made 
of carbon-fiber-loaded polyphenylene sulfide (PPS) plastic. A polyurethane 
feedthrough block is cast around the 128 fibers and the fiex circuits to form 
the barrier between the warm and the cold ends of the cassette. The fibers 
accept light from the clear fiber waveguides which are connected to the warm- 
end optical connectors at the top of the cassette and pipe the light to the 
VLPCs mounted in the cold-end assembhes. 

The cold-end assembly hangs from the PPS plugs and consists of sixteen 8- 
channel VLPC hybrid assemblies supported on an isotherm. The inset in the 
lower left corner of Figure 15 shows a view of a cold-end assembly supported on 
a 128-fiber bundle, and Figure 17 shows an exploded view of the components 
of a cold-end assembly. 

A VLPC hybrid assembly is composed of a PPS box adhesively bonded to the 
aluminum nitride substrate upon which a VLPC chip is mounted. The molded 
PPS box is precisely positioned (maintaining 25 /im tolerances) so that the 
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Fig. 15. A VLPC cassette supporting AFE readout boards as viewed from the left 
side. The VLPC hybrids are located on the isotherms housed inside the copper cup 
shown at the bottom of the figure. 
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Fig. 16. VLPC cassette body with left side body panel and side panels removed to 
show four installed modules. 

eight polished fibers in the PPS plug are aligned over the individual VLPC 
pixels when the plug and box are mated, thus achieving good light collection 
efficiency while minimizing optical crosstalk between neighboring channels. 
Connectors are clamped across the contact pads on the aluminum nitride sub- 
strates and mated to flex circuits which transmit single-ended electrical signals 
between the cold-end and the AFE. Each module contains two flex circuits, 
and these flexible printed circuits are realized on 5-;um-thick adhesiveless cop- 
per coatings on a 51-/xm-thick polyamide base material. The individual traces 
are 76 /xm wide with minimum 89 /xm spacings between circuit features. Each 
flex circuit is 41.1 cm long. The isotherm also supports a cahbrated carbon 
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Fig. 17. Cold-end assembly for one 128-cliannel module of a VLPC cassette. 

resistor that serves as a temperature sensor, resistors used as heaters, and 
the required springs and fasteners. The temperature sensor and heaters are 
employed to control the temperature of the VLPCs to within 0.1 K. 

The cassette body can be viewed as composed of cold-end and warm-end me- 
chanical structures. The cold-end structure (that portion of the cassette that 
is inserted in the cryostat) comprises several sub-assemblies: the feedthrough 
assembly, the G-10 side walls, the heat intercept assemblies, and the cold-end 
copper cup. The cassette is mounted to the top plate of the cryostat at the 
feedthrough assembly. This assembly provides the gas-tight seal for the cold, 
< 2 psig, stagnant helium gas volume within the cryostat. Side walls composed 
of G-10 support the top (or liquid nitrogen) intercept which serves to cut off 
the flow of heat from the warm end. Another set of G-10 side walls support 
the bottom (or liquid helium) intercept. The bottom intercept supports the 
copper cup which surrounds the isotherms at the ends of the modules. 
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The warm-end structure is made of parallel tin-plated aluminum panels sep- 
arated by spacer bars that form a protective box for the optical fibers. Rails 
mounted on the aluminum panels support the two AFEs. The warm-end 
Cin::apse [66] connector assembly enables the connection between the flex 
circuits and the AFEs. The AFEs mate to backplane connectors mounted on 
a backplane support structure via card-edge connectors. The backplane sup- 
port structures are bolted to the VLPC cryostats, and thus the combination 
of cassettes and cryostat serve as the crates for the AFEs which are mounted 
on the cassettes. This design, with connections on two orthogonal edges of 
the AFE, allows the AFEs to be removed for service without extracting the 
cassette from the cryostat. 

The CFT requires 76,800 channels of VLPC readout, and the central and 
forward preshower detectors (Section 4) are instrumented with an additional 
22,564 channels of VLPC readout. The ninety-nine cassettes necessary to pro- 
vide this readout are mounted in two custom-designed cryostats located on 
the platform beneath the D0 detector. Over 99.8% of the individual VLPC 
channels in these cassettes met or exceeded the desired performance specifi- 
cations during cryogenic qualification tests performed prior to installation at 
D0. 



2.2.5 CFT readout electronics 

The CFT and the central and forward preshower detectors (Section 4) share a 
VLPC-based readout as well as similar Level 1 and Level 2 trigger electronics, 
and therefore all three use the same front-end electronics to process the signals 
from the VLPCs. The front-end electronics are custom printed circuit boards 
(the AFEs) approximately 14" tall (9U) and 18" long which are mounted on 
the VLPC cassettes inserted into cryostats as described in Section 2.2.4. 

The AFE is a large and complex board that must perform a number of func- 
tions with competing requirements. It has charge-sensitive amplifiers to deal 
with the very small signals from the VLPCs. It is part of the Level 3 read- 
out, part of the Level 1 and Level 2 triggers, and part of the slow control 
and monitoring system. It must also control the bias and temperature of the 
VLPCs. This functionality must be embedded in the AFE because it is the 
only piece of electronics that interfaces to the VLPCs. It must serve three 
different sub-detectors with different dynamic range requirements and comes 
in two types — left-handed and right-handed, depending on which side of the 
cassette body the board is mounted. 

A number of features make it possible for the AFE to fulfill all of the above 
requirements. First, only a single printed circuit board was designed and laid 
out. The "handedness" of the board is determined by the way a few key com- 
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ponents are installed. So, for example, there are mounting points and traces for 
the hard metric connectors on both ends of the board. When the connector is 
mounted on one end of the board, the board becomes left-handed and mounts 
on the left side of the cassette. When the connector is mounted on the other 
end of the board, the AFE is right-handed. The great majority of the compo- 
nents are mounted exactly the same way on both left- and right-handed AFEs. 
Second, the most noise sensitive parts of the board, including the front-end 
amplifier chips, are mounted on separate multi-chip modules (MCMs), each 
with its own regulator for the power and separate ground planes. The am- 
phfier chips are wire bonded directly to these much smaller (3.5" by 1.5") 
subassemblies. This allows the very fine pitch required for wire bonding to 
be confined to only the MCM substrate. Otherwise the AFE boards would 
not be manufacturable. This also allows the MCM subassemblies to be tested 
separately from the AFEs and to be removed as required for repair or replace- 
ment. There are eight MCMs on each AFE, each serving sixty-four VLPC 
channels, to match the construction of the cassette modules as described in 
Section 2.2.4. The MCMs are intended to be identical. To accommodate the 
different dynamic ranges of the CFT, the central preshower detector, and the 
forward preshower detector, capacitive charge division is used. By properly 
sizing the AC couphng capacitors on the AFE, the charge seen by the ampli- 
fiers is adjusted to accommodate the required dynamic range with the same 
electronics. 

To further reduce the cost and simplify the system, the front-end amplifier and 
digitizer is the same chip used for the SMT. This also facihtates commonahty 
further downstream in the readout chain. The SVXIIe and its readout are de- 
scribed in Section 2.1.3. On the AFE, the SVXlle provides for the integration 
of the charge signals from the VLPCs, a pipeline for storing the signals while 
the trigger is formed, and digitization of the signals and sparsification of the 
digitized data for readout. There are eight SVXIIe chips on every AFE, one 
on each MCM. The SVXIIe chips share a single 8-bit bus for readout. How- 
ever, because the signals from the AFE are also needed for the trigger system 
and because the SVXIIe digitization speed is too slow to generate a trigger 
decision, a second chip, the SIFT chip, provides a trigger pickoff. A simplified 
schematic is shown in Figure 18. Each SIFT chip has eighteen channels so 
there are four SIFT chips on every MCM (eight channels are unused). The 
SIFT chips receive the signals from the VLPCs before the SVXIIe does. For 
each channel, the SIFT has a preamplifier that integrates the incoming charge 
and switched capacitors that are used to split the amplified signal and send it 
along two paths: one to the SVXIIe, for subsequent digitization and readout, 
the other to a discriminator which fires if the charge exceeds a preset threshold 
(typically 10 to 15 fC). 

There are five clock signals that control the operation of the SIFT, as can be 
seen from the schematic. One is the reset of the integrator, PRST, another 
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Fig. 18. Simplified schematic diagram of tlie SIFT diip. Vclamp, Vthr, and VREF 
are externally-supplied DC voltage levels. 

is the reset for the discriminator, DRST. The third, SH (sample and hold) 
samples the discriminator output and the analog value of the integrator at the 
end of the cycle. READ transfers the analog charge to the SVXIIe. PCLMP 
resets the bias for the followers in the analog chain. All of these signals are 
derived from the main accelerator clock (53 MHz). 

The digital signals from the discriminators serve as the inputs to the Level 1 
central track trigger (LICTT, Section 9.1.3)) and a bit is sent to the trigger 
system for every axial fiber every 132 ns (the time originally anticipated be- 
tween beam crossings). This means that each APE board is transmitting data 
at about 4.1 Gbits/s. The formatting and pipelining of this data is accom- 
plished by sixteen CPLDs (complex programmable logic devices) in conjunc- 
tion with four fast FIFO (first-in, first-out) memories. The trigger data is sent 
over four LVDS (low- voltage differential signal) links. Each LVDS link is driven 
by Texas Instruments SN65LVDS95 transmitter chips [67]. Each chip has 21 
bits of parallel-load, serial-out shift registers driven by a 7x clock synthesizer 
and drives four LVDS lines. Three hue pairs are used to transmit 21 bits, and 
the fourth carries the clock. With the data loaded into the transmitter chips 
with the 53 MHz clock, the APE can send 21 x 7 x 4 = 588 bits every 132 ns. 
One bit on each link is used to carry the 53 MHz clock to help synchronize the 
data frames at the receiver end. This leaves 20 x 7 x 4 = 560 bits for trigger 
information. The actual discriminator information is carried by 512 bits. The 
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other bits are used to send control information to the LICTT. These include 
indication of which crossings had beam present, when a Level 1 trigger accept 
was received from the trigger system, when the AFE is in a test mode or in 
reset, and so on. The control bits are duplicated on each of the four hnks and 
this redundancy is used to provide diagnostic information about the integrity 
of the links from the AFE to the LICTT. 

There are twenty CPLDs on each AFE. Besides the sixteen used to handle 
the discriminator data, one CPLD is used as a "virtual" SVXIIe chip to allow 
stored discriminator data to be read out on the same bus as the SVXIIe chips. 
Another CPLD is used to generate all the signals required to operate the 
SIFT chips and other timing signals for the board. The last two CPLDs work 
in conjunction with a microcontroller on the AFE to implement communica- 
tions with the monitoring and slow control system via the MIL-STD-1553B 
bus. The microcontroller is a mixed signal controller PIC14000 from Microchip 
[68]. It has an integrated single-slope 16-bit ADC which is used to monitor 
analog values on the board such as VLPC bias, VLPC current, and VLPC 
temperature. The temperature of the VLPCs is measured via calibrated car- 
bon resistors mounted near the VLPC chips on each module. The value of the 
resistance must be measured to better than one part in a thousand and this 
drives the requirement for the ADC. The microcontroller implements closed- 
loop control for individual heater resistors on each VLPC module which allows 
the temperature at the VLPCs to be kept constant to 9.00 ± 0.05 K despite 
larger cryostat temperature fluctuations. The VLPC temperature monitoring 
and control is performed by the right-handed AFE boards. The VLPC bias 
voltage (which varies between 6 and 8 volts from module to module) must be 
controlled to approximately 50 mV to achieve optimal detector performance. 

The extensive use of programmable logic on the AFE (twenty CPLDs and a 
microcontroller) greatly eased the tasks of designing, building, and operating 
it. The design of the AFE could be completed before all details of the inter- 
connected detector systems were finalized. A single printed circuit board is 
flexible enough to instrument three very different detectors. Moreover, this 
intricate board operates with little external control: once set points and oper- 
ating parameters are downloaded, firmware on the board controls the system 
using on-board DACs and ADCs. We are also able to modify the firmware to 
optimize the operation of the electronics as running conditions change. 

The performance of the electronics is dictated by the physics requirements of 
the detector. The small-diameter scintillating fibers used in the CFT coupled 
with the long waveguides necessary to carry the signals to the platform cause 
the signals generated by the VLPCs to be small {^10 photoelectrons incident 
upon the VLPCs). To assure acceptable efficiency for triggers and tracking, 
the individual channel thresholds must therefore be set between 1.5 and 2 pho- 
toelectrons (pe). To maintain a low and stable threshold and to distinguish 
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Fig. 19. A typical LED spectrum for a single VLPC for an axial CFT fiber. Every 
channel is fit automatically and the parameters of the fit are extracted and used for 
monitoring. Typically, more than 97% of the axial channels are fit successfully. The 
solid histogram is the data; the smooth curve is the fit. 

individual photoelectron peaks during calibration, the analog signal must be 
digitized with a noise of less than 0.4 pe, which is equivalent to about 2 fC. In 
fact, the front-end electronics achieve or exceed all requirements. The mean 
pedestal width from fits to LED calibration spectra (Section 2.2.6) for all axial 
fibers is 0.24 pe or 1.6 fC, and discriminator thresholds have similar noise and 
offsets of less than 2 fC so that it is possible to set discriminator thresholds 
below 10 fC for most channels. A sample spectrum from calibration data is 
shown in Figure 19. A summary of the important parameters for the AFE is 
given in Table 3. 

The readout of the SVXIIe chips mounted on the AFE boards is coordinated 
via signals from the sequencers and sequencer controllers. The sparsified data 
is transferred from the sequencers to VME transition modules (VTM) via fiber 
optics cables. The VTMs transfer the data to buffers in VRBs in VME VIPA 
[69] crates. A VRBC mounted in the same crate controls the assignment of 
buffers. A single-board computer mounted in that crate serves as the inter- 
face to the higher level readout. The readout of the CFT and the preshower 
detectors is buffered in four VME crates. Details of the higher level readout 
system are provided in Sections 2.1.3 and 10. 



2.2.6 Calibration 

The CFT and the preshower detectors (Section 4) are each equipped [70] with 
fast Nichia [71] blue-emitting LED pulsers that can be used to perform several 
functions. The pulsers certify the proper connectivity and yes-no operation of 
the fiber channels and attached readout chain, provide a means for monitoring 
the stability of the VLPC readout over time, and calibrate the response of 
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Table 3 

Summary of AFE board characteristics 



AFE overview 



Number of readout channels per AFE 512 

Number of MCMs per AFE 8 

Total number of individual components on 2300 
AFE 

Threshold settings 4 per MCM 

(analog V generated by onboard DACs) 

Pedestal settings 1 per MCM 

(analog V generated by onboard DACs) 

Output bandwidth (LI trigger) 4200 Mbit/s 

Output bandwidth (SVXIIe bus) 159 Mbit/s 

AFE performance 

1.6 fC 
1.2 fC 

2 fC 

3 fC 



Noise (input referred) — analog readout 
Noise (input referred) — discriminator 
Threshold spread (rms) 
Pedestal spread (rms) 
AFE stability and reliability 

Mean time between failures (estimated) 
Calibration stability 



35000 hrs/board 
Better than 1% 



individual channels or, more specifically, provide a relative channel-to-channel 
energy calibration of the fiber- VLPC system. This monitoring and calibration 
is done during detector commissioning or between coUider stores. Although the 
function of the LED system is the same for all three detectors, the method of 
light injection differs for each. 

The limited space at the ends of the CFT cylinders complicates injection 
of light directly into the ends of the scintillating fibers. However, a method 
has been devised to introduce light through the cladding walls and into the 
active core of the fiber. The method takes advantage of the fact that the 3HF 
dye in the CFT fibers has a small absorption in the blue wavelength range 
(fs 450 nm). Blue hght incident on several layers of the scintillating fiber can 
be absorbed in the top layer, exciting the 3HF dye and producing scintillation 
photons detectable by the VLPC. To distribute the light over the cylindrical 
geometry of the fiber tracker, fiat optical panels consisting of a single thin 
ribbon of 100 (typically) clear fibers, each approximately 500 /^m in diameter, 
are degraded in certain local regions so that hght is emitted through their 
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cladding walls. The fibers are bundled together at one end of the ribbon, 
potted, and finished to allow coupling with an LED. The fiat optical panels 
are then mounted around every fiber cylinder near each end of the cylinder and 
driven by pulsars. The use of two bands provides not only a margin of safety 
against failure of an individual optical element but also allows comparison of 
the light from the two ends of the tracker and monitoring of any changes in 
the quality of the scintillating fibers over time. 

Although similar flat optical panels could have been adapted to the preshower 
detectors, the CPS and FPS use different designs. For the preshower detec- 
tors, injection of LED light directly into the scintillator strips complicates the 
design appreciably, so instead, light is injected into the wavelength shifting 
(WLS) flbers. Since the WLS flbers are grouped in sets of sixteen channels 
and routed from the scintillator strip to connectors located at the perimeter 
of the detectors, one LED illuminates a group of sixteen WLS fibers. The 
mechanism, however, for delivering light into these sixteen fibers differs for 
CPS and FPS. 



In the CPS, two LEDs are mounted inside a machined Lexan light block, 
directly before the outer perimeter of the detector, one on either side of the 
connector holding the WLS fibers. Ten LEDs mounted on one side of the 
connector are chained in series, allowing for an RG-178 cable to supply power 
to each LED string. The series of grouping ten LEDs continues across the 
perimeter of the CPS detector. 

LEDs for the FPS system [72] are also mounted on the outer perimeter of 
the detector. However, due to the tight spatial constraints inside the FPS 
scintillating wedges, a 0.835-mm-diameter clear fiber transports the blue light 
to a group of sixteen WLS fibers, systematically arranged within a hollow 
cylindrical cavity. The clear fiber is inserted directly into the central hole of 
the cavity, allowing for light to be delivered uniformly over a full solid angle 
to the sixteen WLS fibers. The cavity holds the same group of WLS fibers 
that are routed from their respective scintillator strips to optical connectors 
coupling the clear fiber waveguides. The LEDs themselves are mounted on two 
PC boards, each providing the relevant electrical circuitry to drive the device. 

PC boards located on the readout platform supply power to the LED system of 

each detector. The entire system is computer-controlled and can be operated 
directly from the control room, allowing users to program the pulse height 
and width as well as operate one LED in a detector at a time or the complete 
array. 
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3 Solenoidal magnet 



The superconducting solenoidal magnet was designed [73,74] to optimize the 
momentum resolution, 5pt/pt-i and tracking pattern recognition within the 
constraints imposed by the Run I detector. The overall physical size of the 
magnet was determined by the available space within the central calorimeter 
vacuum vessel: 2.73 m in length and 1.42 m in diameter. We selected a central 
field of 2 T after considering the momentum resolution and tracking pattern 
recognition, the available space, and the thickness of the cryostat which de- 
pends on the thicknesses of the conductor and support cylinder. In addition, 
the magnet is required i) to operate safely and stably at either polarity, ii) 
to have a uniform field over as large a percentage of the volume as practical, 
ill) to be as thin as possible to make the tracking volume as large as possible, 
iv) to have an overall thickness of approximately IXq at = to optimize 
the performance of the central preshower detector mounted on the outside of 
the solenoid cryostat, and v) to quench safely without a protection resistor 
(although one is installed to reduce the recool time after an inadvertent fast 
dump). Services such as cryogens, magnet current buses, and vacuum pumpout 
and relief must reach the magnet from the control dewar through the narrow 
space (7.6 cm) between the central and end calorimeter vacuum vessels. The 
magnet system is controlled remotely, including cool down, energization, de- 
energization for field reversal, quench recovery, and warmup, without access 
to the magnet cryostat, service chimney, or control dewar. 

The major parameters of the solenoid design are listed in Table 4. A perspec- 
tive view of the solenoid inside the central calorimeter with its chimney and 
control dewar is shown in Figure 20. 

The solenoid, along with its cryostat, control dewar, and connecting service 
chimney, was manufactured by Toshiba Corp. [75] in Yokohama, Japan. The 
system was specified to operate safely and reliably over a twenty-year lifetime 
with up to 150 cool-down cycles, 2500 energization cycles, and 400 fast dumps. 



3.1 Magnet construction 

The solenoid is wound with two layers of superconductor to achieve the re- 
quired linear current density for a 2 T central field. The support cylinder is 
located on the outside of the windings to support the radial Lorentz forces on 
the conductor, to provide axial rigidity to the finished coil, to provide a high 
thermal conductivity path to the helium coolant piping, and to ensure reli- 
able quenchback for quench safety. To maximize the field uniformity inside the 
bore of the magnet, the current density in the windings is larger at the ends of 
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Table 4 

Major parameters of the solenoid 



Central field 

Operating current 

Cryostat warm bore diameter 

Cryostat length 

Stored energy 

Inductance 

Cooling 

Cold mass 

Conductor 

Conductor stabilizer 

Thickness 

Cooldown time 

Magnet charging time 

Fast discharge time constant 

Slow discharge time constant 

Total operating heat load 

Operating helium mass flow 



2.0 T 
4749 A 
1.067 m 
2.729 m 
5.3 MJ 
0.47 H 

Indirect, 2-phase forced flow helium 
1460 kg 

18-strand Cu:NbTi, cabled 

High purity aluminum 

0.87 Xo 

< 40 hours 

15 minutes 

11 seconds 

310 seconds 

15 W plus 0.8 g/s liquefaction 
1.5 g/s 



the coil. This is accomphshed by the use of a narrower conductor at the ends 
of the coil. Cross sectional views of the conductors are shown in Figure 21. 
Both conductors are made with a superconducting Rut her ford- type cable of 
multifilamentary Cu:NbTi strands stabilized with pure aluminum. The basic 
strand has a Cu:NbTi ratio of 1.34:1 and a diameter of 0.848 mm; eighteen 
strands are used in each conductor. 



Both conductors are used in both layers. The middle section of each layer 
is wound with the wider conductor and the end sections with the narrower 
conductor. The transition point between the two conductors in the inner layer 
occurs at z = ±0.941 m, and at z = ±0.644 m in the outer layer. At the four 
locations where the conductor width changes, the two types of conductor are 
joined with a soldered lap joint one full turn in length. There are no other 
joints in the coil. 
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Fig. 20. Perspective view of the solenoid inside the central calorimeter. One end 

calorimeter, several muon chambers, and parts of the toroids have been omitted for 
clarity. Also shown are the service chimney and control dewar. 
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Fig. 21. Cross sections of the two conductors used in construction of the solenoidal 
magnet. 



3.2 Magnet cryostat 



The magnet cryostat consists of four major components: the vacuum vessel, 
the liquid-nitrogen-coolcd radiation shield, the cold mass support system with 
liquid-nitrogen-cooled intercepts, and the helium cooling tube on the outer 
support cylinder of the superconducting coil. 

The vacuum vessel consists of inner and outer coaxial aluminum shells with flat 
annular bulkheads welded to each end. The superconducting buses from the 
coil and the cryogen pipes from the outer support cylinder and the radiation 
shields leave the vacuum vessel through the service chimney nozzle welded in 
the bulkhead at the south end of the cryostat. The cryostat is designed for full 
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internal vacuum and for an internal relieving pressure of 0.44 MPa (6.4 psig). 

The magnet cold mass, the superconducting coil and outer support cylin- 
der, weighs 1.46 metric tons. The cold mass support system consists of axial 
members which locate the coil axially and support it against axial thermal, 
decentering, and seismic forces, and nearly tangential members that locate the 
coil radially and provide radial support against thermal, gravitational, seis- 
mic, and decentering forces. The support members connect the outer support 
cyhnder of the coil to the flat annular bulkheads of the vacuum vessel. All cold 
mass supports have thermal intercepts that operate near 85 K. The magnet 
cryostat is attached to the central calorimeter by support brackets that carry 
the weight of the cryostat and the tracking detectors that are attached to it, 
plus any residual magnetic decentering loads from the muon steel. 



3.3 Control dewar and refrigeration system 

The control dewar is the interface between the fixed cryogenic piping and the 
detector, which must be moved from the assembly area into the coUision hall. 
It has bayonet connections for cryogenic lines and contains the vapor-cooled 
current leads and a liquid-helium reservoir, helium supply subcooler, helium 
flow control valve, and other valving and instrumentation. The current leads 
carry the full operating current of the magnet at the optimum cooling gas flow 
rate and are designed for safe operation without cooling gas flow for at least 
the full slow-discharge time constant of the magnet (approximately 310 s) in 
the event that cooling flow is lost while the magnet is de-energized. 

Cryogenic and electrical services are carried from the control dewar to the 
magnet cryostat via the service chimney, which also serves as the relief line for 
the solenoid vacuum space and provides a path for pumpout of the magnet 
cryostat and control dewar vacuum spaces. 

A cryogenic refrigeration system supplies liquid nitrogen and liquid helium to 
the magnet and the VLPC cryostats for the CFT and central and forward 
preshower detector readouts (Section 2.2). The refrigeration requirements of 
the magnet and VLPC systems, as well as operation of the detector in the col- 
lision hall and adjacent assembly hall, were considered when the refrigeration 
system was designed. 

A standard Fermilab sateUite stand alone refrigerator (STAR) provides he- 
lium refrigeration. The capacity of the STAR is sufficient for non-simultaneous 
cooldown and simultaneous operation of both the solenoid and VLPC systems. 
Liquid helium is stored in a 3000 L dewar which supplies the magnet control 
dewar and the VLPC cryostats via separate transfer lines. 
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Fig. 22. Block diagram of the DC energization system for the solenoid. 
3.Jj. Magnet energization and control 



Solenoid 



A block diagram of the DC energization system is shown in Figure 22. The 
power supply is a special Fermilab unit designed for superconducting loads. It 
is a twelve-phase-thyristor water-cooled rectifier unit with precision feedback 
current regulation. The power supply taps are set at 15 V/5000 A for efficient 
operation and reduced AC loading and DC ripple. The power supply regulates 
the current to within 0.01% using an external precision Holec [76] 5000 A direct 
current current transducer (also known as a DCCT or transductor) installed 
downstream of the ripple filter and dump resistor. 

Magnet polarity is reversed using a 5000 A DC mechanical motorized polarity 
reversing switch and a switch controller. Polarity reversal requires complete 
discharge of the solenoid followed by recharging at the opposite polarity. The 
controller confirms that the polarity reversal occurs at zero current load and 
that the power supply is turned off. Polarity reversal takes about forty minutes. 

The Texas Instruments TI565T Programmable Logic Controller (PLC) (origi- 
nally installed to operate the liquid argon calorimeter refrigeration system, the 
muon chamber gas systems, and various building utility and safety systems) 
has been expanded to control and monitor the VLPC cryostats, solenoid, and 
helium refrigeration systems. The PLC is a stand-alone system with an inter- 
nal battery-backed program memory that requires no host system to download 
the control programs in the event of a power failure. It consists of two indepen- 
dent TI565T processors operated in a "hot backup" configuration. One PLC 
is online and actively controlling the system; the second is in standby, running 
step-for-step with the online unit but with its input /output communication 
disabled. Each PLC runs continuous internal diagnostics for errors. When a 
fatal error is registered by the active PLC, it is taken offline and the standby 
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PLC is put online without intervention or disruption to the system. 

Dedicated control and monitoring of the magnet energization and protection 
system is done by a new Texas Instruments TI555 PLC. A quench protection 
monitor (QPM) hardwired chassis and interlock logic unit provide primary 
quench protection for the magnet. The QPM contains filtering, signal aver- 
aging, and delay circuitry for the voltage taps and thermometry which are 
used in the quench detection logic, vapor-cooled lead fault detection, or power 
supply failure logic. It contains preset limits for selected sensors which trigger 
fast or slow discharge of the magnet and it preserves the time ordering of 
the detected fault signals which trigger magnet discharge. The QPM defines 
a set of interlock conditions that must be satisfied before the magnet can be 
energized or the reversing switch operated. 

The cryogenic controls and PLCs arc powered by a 10 kW uninterruptable 
power supply that is backed up by an automatic diesel power generator. The 
total power consumption is approximately 6 kW. 

3.5 Magnetic field 

The magnetic field of the full magnet system is modeled using the TOSCA 
[77] program. The calculated field map was compared with the measured field 
in two locations: near the internal radius of the solenoid cryostat (r ^ 54 cm) 
at z = 4 cm and in the gap (at {x, y, z) = (0, 372, 105) cm) at the top of 
the central muon toroid steel (Section 6.1). Within the solenoid (operated 
at 4749 A), the measured field is 20.141 ± 0.005 kC; the calculated field at 
this location is 20.158 kC The calculated magnetic field is scaled by 0.09% 
to agree with the measurement. With full operating current (1500 A) in the 
toroid coils, there is a 4.3% difference between the calculated and measured 
field at the central toroid gap, requiring an adjustment in the calculated field 
for this magnet. The y — z view of the magnetic field with both the toroid and 
solenoid magnets at full current is shown in Figure 23. 
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z (cm) 

Fig. 23. The y — z view of the D0 magnetic field (in kG) with both the toroidal 
and solenoidal magnets at full current (1500 A and 4749 A, respectively). The field 
in the central toroid is approximately 1.8 T; that in the end toroids is about 1.9 T. 
The field lines are projections onto the y — z plane; the left and right line ends differ 
by up to 2.5 m in x. 

4 Preshower detectors 

The preshower detectors aid in electron identification and background re- 
jection during both triggering and offline reconstruction. They function as 

calorimeters as well as tracking detectors, enhancing the spatial matching be- 
tween tracks and calorimeter showers [78]. The detectors can be used offline 
to correct the electromagnetic energy measurement of the central and end 
calorimeters for losses in the solenoid and upstream material, such as cables 
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and supports. Their fast energy and position measurements allow preshower 
information to be included in the Level 1 trigger. The central preshower detec- 
tor (CPS) covers the region |?7| < 1.3 and is located between the solenoid and 
the central calorimeter with an inner radius of 28.25" and an outer radius of 
29.21". The two forward preshower detectors (FPS) [72] cover 1.5 < I77I < 2.5 
and are attached to the faces of the end calorimeters. The preshower detectors 
can be seen in Figure 2. 



4-1 Common properties of the preshower detectors 

Both preshower detectors are made from triangular strips of scintillator, as 
shown in Figure 24. Since the triangles are interleaved, there is no dead space 
between strips and most tracks traverse more than one strip, allowing for 
strip-to- strip interpolations and improved position measurement. The strips 
are made by extruding polystyrene plastic doped with 1% p-terphenyl and 
150 ppm diphenyl stilbene, with a light yield similar to that of commercial 
Bicron BC-404 scintillator. Each scintillator strip is machine-wrapped in alu- 
minized mylar for optical isolation, and the ends are painted white to enhance 
reflectivity. The packing density is different for the CPS and the FPS mod- 
ules, resulting in different layer thicknesses and strip pitches. Because of the 
nesting process, which requires epoxying the strips together to form a layer, 
the measured pitch can differ by up to 20% from the design dimensions shown 
in Figure 24. After extrusion and wrapping, the triangular strips have a ten- 
dency to bow. To relieve stress in the plastic, making them easier to handle, 
the strips were slumped to the required shapes by heating to about 180° F for 
two hours followed by gradual cooling at room temperature. 

Embedded at the center of each triangular strip is a wavelength-shifting fiber 
that collects and carries the light to the end of the detector. The non-readout 
ends of the WLS fibers are diamond-polished and silvered. At the readout 
end, fibers are grouped into bunches of sixteen and potted into connectors for 
transition to clear light-guide fibers. Light is transmitted via the clear fibers 
to VLPC cassettes (Section 2.2.4) for readout. Both the WLS and clear fibers 
are 835-//m-diameter Kuraray multiclad fibers. 

The preshower detectors share common elements with the central fiber tracker, 
beginning with the waveguides and continuing through the entire readout elec- 
tronics system. The last elements which are unique to the preshower detectors 
are the connections between the wavelength shifting fibers and the waveg- 
uides. The waveguides, VLPC cassettes, and readout electronics are described 
in Sections 2.2.3 - 2.2.5. The calibration systems for the preshower detectors 
are also similar to that of the CFT and are described in Section 2.2.6. 
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Fig. 24. Cross section and layout geometry of the CPS and FPS scintillator strips. 
The circles show the location of the embedded wavelength-shifting fibers. Design 
dimensions are shown. 

4-2 Central preshower detector 

The CPS consists of three concentric cylindrical layers of triangular scintillator 
strips and is located in the nominal 5 cm gap between the solenoid and the 
central calorimeter. Between the solenoid and the CPS is a lead radiator 7/32" 
thick (approximately 1 radiation length (Xq)) and 96" long, covering \t]\ < 
1.31. The lead is covered by stainless steel skins 1/32" thick and 103" long. 
The solenoid itself is 0.9Xo thick, providing a total of about two radiation 
lengths of material for particles at normal incidence, increasing to about four 
radiation lengths at the largest angles. 

The three layers of scintillator are arranged in an axial-u-f geometry, with a 
u stereo angle of 23.774° and a v stereo angle of 24.016°. Each layer contains 
1280 strips. The WLS fibers are split at 2; = and read out from each end 
resulting in 2560 readout channels/layer. The geometry of the CPS axial layer 
matches that of the CFT for Level 1 (Section 9.1) triggering purposes. Each 
group of sixteen WLS fibers from the CPS axial layer corresponds to one of 
the eighty CFT sectors in 0. As with the CFT, the stereo layers are not used 
in the Level 1 trigger. However, unlike the CFT, the stereo layers of the CPS 
are used in the Level 2 trigger. 

Each layer is made from eight octant modules. The modules consist of two 
1/32" stainless steel skins with the scintillator strips sandwiched in between. 
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4.5 m 



Fig. 25. The CPS unwrapped in a plane. Each rectangle (trapezoid) is one octant 
module of the axial (stereo) layer. Note that the stereo octant edges are precisely 
aligned with the axial octant edges. 

The ends of the stereo modules align to the ends of alternating axial modules, 
as shown in Figure 25. The modules are attached directly to the solenoid 
by bolts at each corner. Eight |" pins at each end of the solenoid provide 
additional registration. Connector blocks are spot welded between the stainless 
steel skins. The blocks provide structural integrity to the end region of the 
modules and mounting locations for the WLS connector and the cover for the 
light-guide connector. 

4-3 Forward preshower detector 

The two FPS detectors (north and south) are mounted on the spherical heads 
of the end calorimeter cryostats, occupying the region between the luminosity 
monitor (Section 8) at the inner edge and the intercryostat detectors (Sec- 
tion 5.2) at the outer edge. Each detector is made from two layers, at different 
z, of two planes of scintillator strips. A 2Xo-thick lead-stainless-steel absorber 
separates the two layers, as shown in Figure 26. The upstream layers (those 
nearest the interaction region) are known as the minimum ionizing particle, 
or MIP, layers while the downstream layers behind the absorber are called 
the shower layers. Charged particles passing through the detector will register 
minimum ionizing signals in the MIP layer, allowing measurement of the loca- 
tion (in 7], (j), and z) of the track. Electrons will readily shower in the absorber, 
leading to a cluster of energy, typically on the order of three strips wide, in 
the shower layer that is spatially matched with the MlP-layer signal. Heav- 
ier charged particles are less likely to shower, typically producing a second 
MIP signal in the shower layer. Photons will not generally interact in the MIP 
layer, but will produce a shower signal in the shower layer. The shower layers 
cover the region 1.5 < |?7| < 2.5 and the MIP layers and the absorber cover 
the region 1.65 < |?7| < 2.5. The outer region of the FPS, 1.5 < |?7| < 1.65, 
lies in the shadow of the solenoidal magnet coil, which provides up to 3Xq of 
material in front of the FPS. This amount of material readily induces showers 
that can be identified in the shower layers of the detector. 

Each FPS detector has four measuring planes: MIP u and v and shower u 
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Fig. 26. Complete ^-segment of a FPS module showing the overlapping u — v MIP 
and shower layers, separated by a lead and stainless steel absorber. 

and V. Each measuring plane is constructed from two layers, each containing 
eight 22.5° wedges (Figure 27) of active material separated by eight wedges 
of inactive material. The active material consists of two sublayers of nested 
scintillator strips with a stereo angle of 22.5° with respect to one another. The 
two layers are separated in z; the WLS fibers are brought to the periphery of 
the detector in the space between the layers where connection blocks facilitate 
the transition to clear waveguides take the light to the VLPC cassettes. Each 
MIP plane has 206 scintillator strips which are perpendicular to an edge at 
constant 0. Each shower layer has 288 strips, also perpendicular to a constant 
(f) edge. Four special wedges in the vicinity of the solenoid cryogenics service 
pipes are notched to allow these to enter and have 142 strips per wedge in 
both the MIP and shower layers. The presence of these special wedges reduces 
the coverage to 1.8 < 1 77 1 < 2.5 in this area. Successive FPS layers are offset to 
prevent projective cracks in 0. An r — view of two layers of the north FPS 
detector is shown in Figure 28 and the three distinct types of wedges and their 
dimensions within the successive FPS 4>, z layers are described in Figure 29. 

The absorber is divided into forty-eight wedge-shaped segments for easier han- 
dling, each subtending 7.5° in (p and weighing approximately 5 lbs. Each seg- 
ment consists of two lead absorber elements cpoxicd to each side of a 1/8" -thick 
stainless- steel plate. Each steel plate is approximately 0.5" longer radially than 
the lead plates, to allow connection to inner and outer support rings that are 
nested within the overall FPS layers. Similarly to the modules occupying the 
MIP and shower layers, the absorber segments are individually bent in three 
dimensions to conform to the spherical geometry of the end calorimeters. The 
4> edges of each segment are beveled to allow nesting of adjacent absorber seg- 
ments with minimal non-projective gaps between them. The total thickness of 
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Fig. 27. Three dimensional view of an FPS module mounted within its supporting 
frame. 

a lead-stainless-steel-lead segment is 11 mm, or 2Xo. 
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Fig. 28. r — (f) view of the north FPS detector. For clarity, only layers 2 (shower) and 
4 (MIP) are shown; layers 1 (shower) and 3 (MIP) are rotated by 22.5° in cp with 
respect to these layers so their supports do not overlap. The south FPS detector is 
a mirror image of the north detector. The cutback near four o'clock accommodates 
the solenoidal magnet cryogenic services on the south side. 
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Fig. 29. Relative orientation of two modules in successive FPS layers. The 12.7 mm 
overlap region is shown, along with the dimensions of the three types of modules. 
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5 Calorimetry 



The D0 calorimeter system consists of three samphng calorimeters (primarily 
uranium/liquid-argon) and an intercryostat detector. 

5. 1 Calorimeters 

The calorimeters were designed to provide energy measurements for electrons, 
photons, and jets in the absence of a central magnetic field (as was the case 
during Run I of the Tevatron), as well as assist in identification of electrons, 
photons, jets, and muons and measure the transverse energy balance in events. 
The calorimeters themselves are unchanged from Run I and are described in 
detail in Ref. [45]. They are illustrated in Figure 30. 

As shown in Figure 31, the central calorimeter (CC) covers |?7| <^ 1 and the two 
end calorimeters, ECN (north) and ECS (south), extend coverage to \r]\ ^ 4. 
Each calorimeter contains an electromagnetic section closest to the interaction 
region followed by fine and coarse hadronic sections. The active medium for 
the calorimeters is liquid argon and each of the three calorimeters (CC, ECN, 
and ECS) is located within its own cryostat that maintains the detector tem- 




Fig. 30. Isometric view of the central and two end calorimeters. 
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Fig. 31. Schematic view of a portion of the D0 calorimeters showing the transverse 
and longitudinal segmentation pattern. The shading pattern indicates groups of 
cells ganged together for signal readout. The rays indicate pseudorapidity intervals 
from the center of the detector. 

perature at approximately 90 K. Different absorber plates are used in different 
locations. The electromagnetic sections (EM) use thin plates (3 or 4 mm in 
the CC and EC, respectively) , made from nearly pure depleted uranium. The 
fine hadronic sections are made from 6-mm-thick uranium-niobium (2%) al- 
loy. The coarse hadronic modules contain relatively thick (46.5 mm) plates of 
copper (in the CC) or stainless steel (EC). 

A typical calorimeter cell is shown in Figure 32. The electric field is estabhshed 
by grounding the metal absorber plates and connecting the resistive surfaces of 
the signal boards to positive high voltage (typically 2.0 kV). The electron drift 
time across the 2.3 mm liquid argon gap is approximately 450 ns. Signal boards 
for all but the EM and small-angle hadronic modules in the EC are made from 
two 0.5 mm G-10 sheets. The surfaces of the sheets facing the hquid argon 
gap are coated with carbon-loaded epoxy [79] with a typical sheet resistivity 
of 40 MQ/O] these surfaces serve as the high voltage electrodes for the gap. 
For one sheet, the other surface is bare G-10; the facing inner surface of the 
second sheet, originally copper-coated, is milled into the pattern necessary for 
segmented readout. Several such pads at approximately the same r) and are 
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\» — 1 Unit Cell — ^ 

Fig. 32. Schematic view of the hquid argon gap and signal board unit cell for the 
calorimeter. 

ganged together in depth to form a readout cell. 

The two smallest-angle modules (EM and hadronic) in each EC have the added 
problem that even small gaps between neighboring azimuthal sectors would 
give undesirable dead regions. Thus, the signal boards for these monolithic 
modules are made from multilayer printed circuit boards. The outer surfaces 
are coated with the same resistive epoxy as for the other signal boards. Etched 
pads on an interior surface give the desired segmentation. Signal traces on 
another interior surface bring the signals to the outer periphery. The pad and 
trace layers are connected by plated-through holes. The signals from these 
multilayer boards in the EM and small-angle hadronic modules are ganged 
together along the depth of the modules. 

Calorimeter readout cells form pseudo-projective towers as shown in Figure 31, 
with each tower subdivided in depth. We use the term "pseudo-projective" 
because the centers of cells of increasing shower depth lie on rays projecting 
from the center of the interaction region, but the cell boundaries are aligned 
perpendicular to the absorber plates. 

There are four separate depth layers for the EM modules in the CC and EC. 
In the CC, the layers are approximately 1.4, 2.0, 6.8 and 9.SXq thick. In the 
EC, they are approximately 1.6, 2.6, 7.9 and 9.3Xq thick. The values given 
for the first layers include all material in the calorimeters themselves from the 
outer warm walls to the first active liquid argon gap. The detector components 
between the interaction region and the first active gap in the CC at 77 = 
provide about A.OXq of material; those between the interaction region and the 
first active gaps of the ECs at 77 = 2 are AAXq thick. 

In the CC, the fine hadronic modules have three longitudinal gangings of 
approximately 1.3, 1.0, and 0.76Xa- The single coarse hadronic module has a 



57 



Fig. 33. Layout of the EC electromagnetic readout cells for the four longitudinal 
EM layers. EMI is closest to the interaction region. MH indicates the EC middle 
hadronic cells. 



thickness of about 3.2A^. The two EC inner hadronic modules (Figure 30) are 
cylindrical, with inner and outer radii of 3.92 and 86.4 cm. The fine hadronic 
portion consists of four readout cells, each l.lA^i thick. The coarse hadronic 
portion has a single readout cell 4.1Aa thick. Each of the EC middle hadronic 
modules has four fine hadronic readout cells of about 0.9Xa each and a single 
coarse hadronic section of 4.4A^. The outer hadronic modules of the ECs are 
made from stainless steel plates inclined at an angle of about 60° with respect 
to the beam axis (see Figure 31). The maximum thickness is G.OXa- Each layer 
is offset from the others to provide hermeticity. 

The transverse sizes of the readout cells are comparable to the transverse sizes 
of showers: 1-2 cm for EM showers and about 10 cm for hadronic showers. 
Towers in both EM and hadronic modules are Ar] — 0.1 and A0 = 27r/64 
0.1. The third layer of the EM modules, located at the EM shower maximum, 
is segmented twice as finely in both rj and to allow more precise location of 
EM shower centroids. As can been seen in Figure 33, cell sizes increase in r] 
and (p at larger r) to avoid very small cells. 
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Fig. 34. Readout chain of the calorimeter in Run II indicating the three major 
components: preamphfiers, basehne subtractor and storage circuitry (BLS), and 
the ADCs. 

5.1.1 Calorimeter electronics 



Figure 34 illustrates the main components in the calorimeter readout chain. 
There are 55,296 calorimeter electronics channels to be read out; 47,032 corre- 
spond to channels connected to physical readout modules in the cryostats. The 
remaining electronics channels are not connected to the detector. (The ADC 
cards are identical and contain enough channels to read out the most popu- 
lated regions of the detector.) The readout is accomplished in three principal 
stages. In the first stage, signals from the detector are transported to charge 
preamplifiers located on the cryostats via low impedance coaxial cable. In the 
second stage, signals from the preamplifiers are transported on twisted-pair 
cables to the analog signal shaping and storage circuits on baseline subtractor 
(BLS) boards. The precision signals from the BLSs are transmitted on an ana- 
log bus and driven by analog drivers over 130 m of twisted-pair cable to ADCs. 
These signals then enter the data acquisition system for the Level 3 trigger 
decision (Section 9.3) and storage to tape. The preamplifiers and BLSs are 
completely new for Run II, and were necessary to accomodate the significant 
reduction in the Tevatron's bunch spacing. 



5.1.1.1 Front-end electronics Signals from the calorimeter cells are trans- 
ported on 30 Q coaxial cables (with a typical length of 10 m) to a feedthrough 
port (the interface between the cold region and the warm region) on the cryo- 
stat and then on to the preamplifiers which are mounted as close as possible to 
the feedthroughs at the top of the cryostat. The cables from the feedthrough 
port to the preamplifier were replaced for Run II to provide better impedance 
matching to the preamplifier input (~ 30 Q) and to equalize the lengths to pro- 
vide better timing characteristics by minimizing the spread of signal arrival 
times. Electron drift time across the 2.3 mm liquid-argon gap remains ap- 
proximately 450 ns at 2.0 kV for Run II, which provides a challenge for signal 
charge integration with beam crossings occurring every 396 ns. The calorimeter 
electronics were designed to maintain the good signal-to-noise ratio obtained 
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during Run I in the expected high instantaneous luminosity environment of 
the original Tevatron Run II design, with a minimum bunch crossing time of 
132 ns. 

The preamplifiers are individually packaged transimpedance (i.e. charge to 
voltage) hybrid amplifiers on ceramic substrates. Forty-eight individual pream- 
plifier hybrids are mounted on a motherboard, with ninety-six motherboards 
housed in a single preamplifier box. Twelve such boxes, mounted on top of the 
calorimeter cryostats, make up the full calorimeter preamplifier system. Since 
access to these preamplifier boxes is very limited, the power supplies for the 
preamplifiers are redundant with each preamplifier box having two supplies, 
a primary and a backup that can be switched in to replace the primary sup- 
ply. Low noise commercial switching power supplies are used to provide the 
necessary power. 

The preamplifier shaping networks are modified for cells of different capaci- 
tance to give approximately the same output waveform for all cells. Given the 
large range of detector capacitances at the input to the preamplifiers, there 
are fourteen species of preamplifier (plus one for readout of the intercryostat 
detector (ICD), Section 5.2) which provide similarly shaped output signals 
to the BLS boards. This is important to maintain good timing for the peak- 
sampling circuit. The characteristics of the preamplifier species are shown in 
Table 5. The ICD feedback capacitor is 22 pF to reduce the gain of the output 
signals and thus preserve their dynamic range. 

Dual parallel input JFETs help maintain low noise performance. Two output 
driver stages provide the capability to drive a terminated 115 f2 twisted-pair 
cable. The power requirement of a single preamplifier is 280 mW. The noise 
performance can be evaluated from the width of the pedestal distribution, 
which is a function of the detector input capacitance. 

The preamplifier motherboard is an eight-layer printed circuit board, with 
ground or power planes of solid copper separating planes containing signal 
traces to minimize noise pickup and cross-talk. The motherboard houses the 
precision resistors (0.1% 10 kfl or 20 kfl, depending on the preamplifier feed- 
back capacitor) for the calibration voltage pulse. A single input line pulses six 
preamplifiers at once using a low capacitance trace. 

All of the electronics is located in an area where there can be a residual 
magnetic field of a few hundred gauss, and so the switching supplies are mag- 
netically shielded. All other devices (including cooling fans) have been verified 
to function in the residual field. New heat exchange systems were installed in 
the existing preamplifier boxes to deal with increased power dissipation. 
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Table 5 

Characteristics of the different preamplifier species used for the calorimeter and the 
ICD readout. Since the cell capacitances depend on the size of the cell, with larger 
cells having higher capacitance, preamplifiers A - D are used in various locations in 

both the central and end calorimeters. FHn stands for fine hadronic, layer n; CHra 
is similar for the coarse hadronic layers; and MG for the CC and EC massless gaps 
(Section 5.2). 



Preamplifier 
species 


(nF) 


Layer 
read out 


Feedback 
cap. (pF) 


T?P 

(ns) 


loiai 

preamp. 

channels 


A 


0.26-0.56 


EM1,2, MG 
EC CH1,2 


5 





13376 


B 


1.1-1.5 


MG 


5 


26 


2240 


p 


1 S 9 R 
1.0 — Z.D 


EC FHl-4, CHl-3 





OO 




D 


3.4-4.6 


CC FHl-3, CHI 
EC FHl-4, CHl-3 


5 


109 


8912 


E 


0.36-0.44 


CC EM3 


10 





9920 


F 


0.72-1.04 


EC EM3,4 


10 


14 


7712 


G 


1.3-1.7 


CC EM4 
EC EM3,4 


10 


32 


3232 


Ha-Hg 


2-4 


EC EM3,4 


10 


47-110 


896 


I 




ICD 


22 





384 



5.1.1.2 Signal shaping and trigger The single-ended preamplifier sig- 
nals are routed from the calorimeter over approximately 25 m of twisted-pair 
cable to the BLSs located below the cryostats, where access is significantly eas- 
ier. The BLSs use switched capacitor arrays (SCAs) as analog storage devices 
to hold the signal for about 4 /^s until the Level 1 trigger decision is made, and 
for an additional 2 ms (on average, with an allowed maximum of 25 ms) until 
the Level 2 trigger decision is made. They also provide baseline subtraction to 
remove any low frequency noise or pileup from the signal. In addition, faster 
shaped analog sums of the signals arc picked off to provide prompt inputs to 
the calorimeter trigger system for both the Level 1 and Level 2 calorimeter 
trigger decisions (Sections 9.1.2 and 9.2.2.1). 

To minimize the effects of pile-up (more than one event in the detector due to 
multiple interactions in a single beam crossing or to interactions in multiple 
beam crossings), only two-thirds of the charge collected by the preamplifier 
circuit, corresponding to the first 260 ns of signal collection from the gap. 
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is used in the shaper circuit. The preamphfier output is an integral of the 
detector signal characterized by a rise time of about 450 ns and a recovery 
time of 15 /is. Shaped signals are sampled every 132 ns. The shaper circuit 
produces a unipolar signal with a peak at about 320 ns and a return to zero 
after ^ 1.2 /is. The shaped signal is sampled at to — 320 ns, close to the 
peak. To subtract the baseline, the signal three samples earlier (to — 396 ns) 
is subtracted by the BLS circuitry. 

The calorimeter Level 1 and Level 2 triggers are based on the energy measured 
in trigger towers of size 0.2 x 0.2 in Ar) x A^, which is obtained by making 
appropriate sums (via resistor packs on the BLS boards) of the fast pickoffs 
at the shaper inputs. The resistor packs have been tuned based on a sampling 
weight optimization study which sought to maximize electron resolution first, 
and jet resolution second, for the channels included in the trigger (the coarse 
hadronic sections do not contribute to the trigger) . 



5.1.1.3 Digitization A BLS board processes signals from the forty-eight 
channels from four pseudo-projective calorimeter towers. Each tower corre- 
sponds to up to twelve preamplifier signals. There are signal sliapcrs for each 
channel on the BLS motherboard, and trigger pick-off and summation circuits 
tap the preamplifier signal prior to the shaper circuitry. The shaped pream- 
plifier signals are fed to daughterboards, one per tower, each of which holds 
five SCA chips. The SCAs contain an array of 48 capacitors to pipeline the 
calorimeter signals. The first and last buffers are not used in the readout to 
avoid edge effects in the chips. The SCA is not designed for simultaneous 
read/write operations, therefore two SCA banks are alternately employed to 
provide the capability to write and read the integrated charges. This scheme 
provides the 4.2 /is buffering necessary prior to the arrival of the Level 1 (Sec- 
tion 9.1) trigger decision. There are also two gain paths (xl and x8) to extend 
the ADC readout dynamic range, thus four of the SCAs are used to store the 
signals for the twelve channels on a daughtercard until the Level 1 trigger 
decision has been made. Once a positive Level 1 decision is received, baseline 
subtractor circuitry on each daughterboard decides channel-by- channel which 
gain path to use and subtracts the stored basehne from the peak signal. It 
then stores the result in the Level 2 SCA that buffers the data until a Level 2 
(Section 9.2) trigger decision has been made. Once a Level 2 trigger accept is 
issued, the data are transferred from the Level 2 SCA to a sample-and-hold 
circuit on the daughterboard and an analog switch on the BLS motherboard 
buses the data on the BLS backplane to analog drivers which transfer the sig- 
nal up to the ADC across 130 m of twisted-pair cable. The gain information 
is sent simultaneously on separate digital control cables. 

The ADC successive approximation digitizers, reused from Run I, have a 12- 
bit dynamic range, but the low and high gain paths for each readout channel 
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effectively provide a 15-bit dynamic range. This matches the measured accu- 
racy of the SCA. The readout system effectively introduces no deadtime up to 
a Level 1 trigger accept rate of 10 kHz, assuming no more than one crossing 
per super bunch ^ is read out. 

A master control board synchronizes twelve independent controllers (one for 
each readout quadrant of the calorimeter) in a shared VME crate. These con- 
trollers provide the timing and control signals that handle the SCA require- 
ments and interface to the Level 1 and Level 2 trigger systems. Each control 
board houses three Altera FPGA (field programmable gate array) chips [80] 
(lOK series, 208-pin packages). Three FIFO pipelines buffer up to about forty 
events awaiting readout. Timers on these event buffers ensure that "stale" 
data are appropriately flagged to the data acquisition system. Other readout 
errors are also flagged in the readout. The control boards permit the readout 
VME crate to be run in numerous diagnostic and calibration modes. 

5.1.1.4 Calibration system The calorimeter calibration system consists 
of twelve identical units for the calorimeter and one slightly modifled unit for 
the ICD (Section 5.2). Each unit is composed of one pulser board, its power 
supply located in the BLS racks on the platform underneath the detector, and 
six active fanout boards housed inside the preamplifier boxes mounted on the 
cryostats. The pulser boards are controlled via a VME I/O register to set the 
amplitude and the timing of the calibration signal and enable the channels 
to be pulsed. A DAC sets the current dehvered by the pulser boards using 
17 bits, with an avarage current/DAC of 0.825 //A/DAC, and the timings are 
controlled through a 8-bit delay line in steps of 2 ns. 

Both the pulser board and the active fanout have been shown to provide a 
pulser signal with a linearity at the per mil level, and all the currents delivered 
are uniform within 0.2% between all boards and 0.1% within a board (Fig- 
ure 35). All of the pulse shapes have been measured to estimate systematic 
effects on the signal amplitude, the timing, and the charge injected. 

5.1.1.5 Gain determination For all calorimeter channels, the gain cali- 
bration factors are determined from deviations of the slope ADC/DAC from 
its ideal value of 0.25 ADC counts per DAC unit. The dispersion of the coeffi- 
cients for electromagnetic (hadronic) channels is about 5% (10%). Systematic 
shifts of the slope values can be observed for different preamplifier types. 

Part of these differences is due to the injection of the calibration signal at 
the preamplifier input, outside of the cryostat. A fraction of the pulser signal 

^ A superbunch is a group of tweive p oi p bunches, where each bunch is separated 
by 396 ns; the Tevatron contains three evenly-spaced superbunches of each particle. 
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Fig. 35. The mean current/DAC delivered by the pulser boards is 825 mA/DAC 
with a spread of (a) ±0.2% for all 15 pulser boards produced and (b) ±0.1% within 
one board. 

travels down the signal cable and is reflected from the calorimeter cell, de- 
pending on the capacitance of the cell, and therefore has a different measured 
shape. The effects are largest for hadronic cells with high capacitance, where 
differences in the timing can produce large tails in the distribution of the cal- 
ibration coefficients. Corrections for these effects have been derived for the 
calibration coefficients, and the delay settings of the pulsers have been tuned 
to maximize the response in the electromagnetic layers. 



Models of the electronics chain have been made to evaluate the differences 
between the electronics response to a calibration signal and a detector signal. 
To render these models realistic, all stable parameters of the signal path from 
the detector to the preamplifier input have been determined from reflection 
measurements. The reflected response (in arbitrary voltage units) to a step 
function is shown in Figure 36 for three different channel types. Quantita- 
tively the values for the cable resistivity outside and inside the cryostat, the 
inductance of the feedthrough and the signal strips, as well as the capacitance 
of each cell, have been determined and used in the simulation model. Cor- 
rection factors to the calibration coefficients indicate these effects are below 
the percent level for electromagnetic channels, when sensed close to the signal 
maximum. 



5.1.2 Liquid argon monitoring 

The purity of the liquid argon is critical to the detector performance as elec- 
tronegative contaminants (particularly oxygen) can combine with electrons 
traversing the gap and can severely impact the energy measurement. The 
liquid argon was recovered from Run I and, before refilling the cryostats 
for Run 11, the purity was remeasured [81] with an external argon test cell 
equipped with ^^^Am and ^°^Ru radioactive sources. The ^"^^Am is an alpha 
source (5 MeV a-particles, 432 yr half-hfe) that was used for purity mea- 
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Fig. 36. Response to reflection measurement for tfiree different channels. Tfie vertical 
voltage scale is in arbitrary units. Cd is the detector cell capacitance. 

surements during Run I; the ^°^Ru is a new beta source (maximum 3.5 MeV 
/5-particles, pal yr half- life) with activity of 30-40 kBq. Calibration of the test 
cell was performed by injecting controlled amounts of O2 into pure argon. The 
contamination of the liquid argon was measured to be less than 0.30±0.12 ppm 
for all three calorimeter cryostats. A 5% signal loss is expected for a contam- 
ination level of 1 ppm. 

Radioactive sources are used to monitor the contamination levels in situ. Each 
of the three cryostats is equipped with four ^^^Am sources with an activity of 
0.1 /iCi and four ^°^Ru sources. Three of the beta sources in each cryostat now 
have very low levels of activity 1 Bq), fifteen years after the initial detector 
construction. One stronger source has an activity of about 4 Bq. The charge 
hberated in the liquid argon gap by the alpha sources is about 4 fC (about 
25,000 electrons) and about half as much for the beta source. The trigger rate 
is about 500 Hz for the alpha source and 0.3 Hz for the strong beta source. The 
argon purity of the three calorimeters has been extremely stable over time. 

A new readout board with a preamplifier, dual operational- amplifier, and dif- 
ferential driver sends the amplified signals via a shielded twisted-pair cable to 
a differential receiver board to be digitized by a 12-bit ADC using a Xilinx 
FPGA (Spartan XCS40XL) [82] . Histograms can be accumulated very rapidly 
(few kHz) on the receiver board which are read out via CAN-bus to a PC 
running National Instruments Lab View [83]. This design is a modification of 
the liquid argon monitoring system [84] for ATLAS and sensitive to less than 
1 ppm of oxygen equivalent contamination. 

The signal response is also a function of the liquid argon temperature so this 
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is monitored as well. The temperature of the liquid argon is maintained at 
90.7 ±0.1 K. 



5.2 Intercryostat detector and massless gaps 

Since the calorimeter system is contained in three separate cryostats, it pro- 
vides incomplete coverage in the pseudorapidity region 0.8 <| r] |< 1.4, as 
can be seen in Figure 31. In addition, there is substantial unsampled mate- 
rial in this region, degrading the energy resolution. To address this problem, 
additional layers of sampling have been added. Within the central and end 
cryostats are single-cell structures called massless gaps — calorimeter readout 
cells in front of the first layer of uranium. The ICD provides scintillator sam- 
phng that is attached to the exterior surfaces of the end cryostats. It covers 
the region 1.1 <| r] \< 1.4; its position with respect to the rest of the detector 
can be seen in Figure 2. The massless gaps are those used in Run I, while the 
ICD is a replacement for a similar detector in the same location (the Run I 
detector had approximately twice the coverage in 77; the space was needed for 
SMT and CFT cabling in Run II). 

The ICD, shown in Figure 37, is a series of 0.5"-thick scintillating tiles (Bicron 
BC-400 [85]) enclosed in light-tight aluminum boxes. Each tile covers an area of 
A?7 X A0 pa 0.3 X 0.4 and is divided into twelve subtiles, as shown in Figure 38, 
each covering Ar] x A0 0.1 x 0.1. Because of the cryogenic services for the 
solenoid, one half of a tile is missing at the south end of the detector, giving 
a total of 378 channels. 

The subtiles are optically isolated from one another by grooves filled with 
epoxy mixed with highly reflective pigment. Each subtile is read out via two 
0.9-mm-diameter wavelength shifting fibers (Bicron BCF-91A) embedded in 
a groove cut to a depth of 3.5 mm near the outside edge of each subtile. A 
third fiber, used for calibration, is also located in the groove. The wavelength- 
shifting fibers are mated to 1.0 mm clear optical fibers (Bicron BCF-98) at 
the outer radius of the ICD tile enclosure. The clear fibers terminate at a 
Hamamatsu R647 [86] photomultipher tube (PMT). 

The ICD electronics are located in a low-magnetic-field region away from the 
tiles and are contained in a drawer system. An ICD drawer houses PMTs, PMT 
electronics, and preamplifiers for six channels of readout. Clear fibers from the 
ICD tiles are mated to clear fibers contained in a light-tight enclosure called 
the "fiber backplane." Between the fiber backplane and the crate containing 
the drawers is a block of iron, with holes drilled to accept the PMTs. Fibers 
from the fiber backplane terminate in "cookies" that hold the ends of the 
fibers in the correct location with respect to the photocathodes of the PMTs. 



66 



Fig. 37. The arrangement of the ICD tiles on the endcap cryostats. The rectangles 
represent the iron block and fiber backplane assemblies in which the ICD electronics 
and PMTs are installed. The beamline is perpendicular to the page. 
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Fig. 38. Each ICD tile is subdivided into twelve straight-edged trapezoidal subtiles. 
WLS fibers for readout are embedded into each subtile along the curved trapezoids. 
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Fig. 39. Cosmic ray signals in all channels of the ICD. 



When a drawer is closed, six PMTs are aligned with six fiber bundles (two per 
channel plus one for a calibration signal in each bundle) from the backplane. 
The PMTs are spring-loaded to ensure good contact with the fibers. The 
iron block, in combination with tubular magnetic shields, protects the PMTs 
from fringe magnetic fields. 0-rings at the base of the PMTs and the drawers 
themselves provide a dark environment for the PMTs. 

The signal electronics are designed to be compatible with the calorimeter 
BLS/ADC system and electronics calibration. The ICD uses a modified version 
of the calorimeter preamplifiers, designed to stretch the PMT signal into a 
signal similar to that of the liquid argon readout. A modified form of the 
calorimeter electronic pulser system is used for electronics commissioning. The 
responses of the PMTs are monitored using an LED calibration system, similar 
in design to that used for the muon trigger scintillation counters (Section 6.4). 
An LED pulser is housed in each of the fiber backplanes, and the amount of 
light is software-controlled. 

Individual channel responses were measured on a test stand using cosmic rays. 
This test stand used the same combination of tiles, fibers, and electronics that 
was mounted in the experiment after testing. Figure 39 shows the distribution 
of cosmic ray peaks from the test stand. ICD sampling weights are taken from 
the full Monte Carlo simulation of the D0 detector and are tuned using dijet 
and photon-jet balance. 









Mean = 368 ADC counts 


: 


RMS = 25.9 ADC counts 
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6 Muon system 



For muon triggering and measurement, the upgraded detector uses the original 
central muon system proportional drift tubes (PDTs) and toroidal magnets 
[45], central scintillation counters (some new and some installed during Run I), 
and a completely new forward muon system. The central muon system provides 
coverage for |?7| < 1.0. The new forward muon system extends muon detection 
to \r]\ a; 2.0, uses mini drift tubes (MDTs) rather than PDTs, and includes 
trigger scintillation counters and beam pipe shielding. The small angle muon 
system [45] of the original detector, including its associated magnets, has been 
removed. 

During Run I, a set of scintillation counters, the cosmic cap [87], was installed 
on the top and upper sides of the outer layer of central muon PDTs. This 
coverage has been extended to the lower sides and bottom of the detector, to 
form the cosmic bottom. These trigger scintillation counters are fast enough to 
allow us to associate a muon in a PDT with the appropriate bunch crossing and 
to reduce the cosmic ray background. Additional scintillation counters, the 
counters, have been installed on the PDTs mounted between the calorimeter 
and the toroidal magnet. The A(f) counters provide a fast detector for triggering 
and identifying muons and for rejecting out-of-time background events. 

The scintillation counters are used for triggering; the wire chambers are used 
for precise coordinate measurements as well as for triggering. Both types of 
detectors contribute to background rejection: the scintillator with timing in- 
formation and the wire chambers with track segments. 

New detectors and the modifications made to the original system arc discussed 
in detail in the following sections; original components are described briefly. 
Exploded views of the muon system are shown in Figures 40 and 41. 

6.1 Toroidal magnets 

The toroidal magnets are described in detail in Ref. [45] and visible in Fig- 
ures 1, 20, and 23. Having a stand-alone muon-system momentum measure- 
ment i) enables a low-pT cutoff in the Level 1 muon trigger, ii) allows for 
cleaner matching with central detector tracks. Hi) rejects tt/K decays, and iv) 
improves the momentum resolution for high momentum muons. 

The central toroid is a square annulus 109 cm thick whose inner surface is 
about 318 cm from the Tevatron beamline; it covers the region |?7| < 1. To 
allow access to the inner parts of the detector, it was constructed in three sec- 
tions. The center-bottom section is a 150-cm-wide beam, fixed to the detector 
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Fig. 40. Exploded view of the muon wire chambers. 



platform, which provides a base for the calorimeters and central tracking de- 
tectors. Two C-shaped sections, which can be moved perpendicularly to the 
center beam, complete the central toroid. The magnet is wound using twenty 
coils of ten turns each. The two end toroids are located at 454 < \z\ < 610 cm. 
In the center of each end toroid is a 183 cm square hole centered on the beam- 
line; in X and y the magnets extend 426 cm from the beamline. The end toroid 
windings are eight coils of eight turns each. 

During Run I, the central and end toroid coils were operated in series at a 
current of 2500 A; the internal fields in the central toroid were approximately 
1.9 T and those in the end toroids were approximately 2.0 T. During Run II, 
the magnets are again being operated in series, but at a current of 1500 A. 
The magnetic field is about 6% lower than that of Run I. Now, however, the 
primary measurement of the muon momentum is performed using the new 
central tracking system and the reduced current provides a substantial cost 
savings. As in Run I, the polarity of the magnets during data collection is 
regularly reversed. 
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Fig. 41. Exploded view of the muon scintillation detectors. 
6.2 Central muon detector 

The central muon system consists of a toroidal magnet (Section 6.1), drift 
chambers, the cosmic cap and bottom scintillation counters, and the A(j) scin- 
tillation counters. 



6.2.1 Central muon drift chambers 

The drift chambers are described in detail in Ref. [45]. The three layers of 
drift chambers are located inside (A layer) and outside (B and C layers) of the 
central toroidal magnet and cover |?7| < 1. Approximately 55% of the central 
region is covered by three layers of PDTs; close to 90% is covered by at least 
two layers. The drift chambers are large, typically 2.8 x 5.6 m^, and made of 
rectangular extruded aluminum tubes. The PDTs outside of the magnet have 
three decks of drift cells; the A layer has four decks with the exception of the 
bottom A-layer PDTs which have three decks. The cells are 10.1 cm across; 
typical chambers are 24 cells wide and contain 72 or 96 cells. Along with an 
anode wire at the center of each cell, vernier cathode pads are located above 
and below the wires to provide information on the hit position along the wire. 
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The wires arc ganged together in pairs within a deck and then read out by 
electronics located at one end of each chamber. 

For each PDT hit, the following information is recorded: the electron drift 
time, the difference AT in the arrival time of the signal pulse at the end of 
the hit cell's wire and at the end of its readout partner's wire, and the charge 
deposition on the inner and outer vernier pads. Both AT and the charge 
deposition are used to determine the hit position along the wire. The drift 
distance resolution is cr 1 mm. The resolution of the AT measurement 
varies depending on whether the muon passes through the cell close to or far 
from the electronics. If the hit occurs far from the electronics, the resolution is 
approximately 10 cm. If it is close, the signal propagates two wire lengths and 
the dispersion in the signal causes the resolution to degrade to about 50 cm. 
Using charge division, the pad signal resolution is about 5 mm. However, only 
the A-layer pads are fully instrumented with electronics; about 10% of the 
B- and C-laycr pads are instrumented. There are several reasons for this: i) 
for tracks traversing all three layers, the pad coordinate does not improve the 
pattern recognition or resolution significantly, ii) for tracks that only reach 
the A-layer, the additional information could help with track matching and 
background rejection, in) the pad signals are used to monitor the gain to track 
aging in the PDTs — the instrumented B- and C-layer pads serve this purpose, 
and iv) fully instrumenting the B- and C-layer pads was too expensive. 

To reduce the charge collection time, we are using a faster gas mixture than we 
used during Run I. The new mixture is 84% argon, 8% methane, and 8% CF4. 
The operating high voltage is 2.3 kV for the pads and 4.7 kV for the wires. The 
drift velocity is approximately 10 cm//is, for a maximum drift time of about 
500 ns. The contribution to the hit position uncertainty due to diffusion is 
about 0.4 mm, worse than the 0.3 mm achieved using a slower gas during Run 
I. The poorer resolution is offset by the reduced occupancy and benefits to 
triggering due to decreasing the number of crossings in the drift time interval 
to two for 396 ns bunch spacing. The gas flow rate is 200 liters per minute, 
providing an exchange rate of three volumes per day. The gas is recirculated 
and filtered to remove contaminants. 

Vapors from the copper-clad Glasteel (polyester and epoxy copolymer sheets 
with chopped glass fibers) [88] cathode pads are deposited on the wires in a 
sheath whose thickness is proportional to the accumulated integrated charge. 
This effect was observed after PDT chamber construction was completed. As 
the coating thickens, the gain of the chamber drops and the chamber becomes 
inefficient. This aging during Run II has been significantly reduced by the 
increased gas fiow, improved shielding to reduce background particles, and 
removal of the Main Ring. The chamber wires could be cleaned if necessary, 
but no aging has been observed up to an integrated luminosity of 0.8 fb~^. 
Since access to the A-layer chambers and the four central B-layer chambers 
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directly under the detector is difficult, the cathode pads in these chambers 
have been replaced by copper-clad GIO and no aging is anticipated. 

6.2.2 Cosmic cap and bottom counters 

The cosmic cap and bottom counters are installed on the top, sides and bottom 
of the outer layer of the central muon PDTs. They provide a fast timing 
signal to associate a muon in a PDT with the appropriate bunch crossing and 
discriminate against the cosmic ray background. 

The cosmic cap counters are described in detail in Ref. [87]. They are made 
from grooved 0.5" Bicron 404A scintillator with Bicron BCF 91A and Ku- 
raray Yll wave-shifting fibers glued into the grooves using Bicron 600 optical 
epoxy. There are 240 counters, 25" wide, and 81.5"-113" long. The counters 
are positioned with their width along z and length along (p. The grooves are 
1.75 mm deep and 4 mm wide; they run along the length of the counter, from 
the end to just past the center. The grooves on each half of the counter are 
offset so they do not overlap at the center of the counter. They are spaced 
8 mm apart so that half of the counter surface is covered with fibers. Each 
groove contains four fibers. The fibers arc glued with five-minute epoxy at 
the ends of the counters and polished using a diamond cutter. To increase 
the light yield, a 1/32" anodized aluminum sheet is attached to the ends with 
aluminized mylar tape. The sides of the counters are milled. The fibers are 
gathered at the center of the counters, divided into two bundles with two fibers 
from each groove in one bundle and two in the other, and epoxied into two 
acrylic plastic disks with holes in the center of each. The ends of the disks are 
polished using the diamond cutter. 

The scintillator is wrapped in a layer of Tyvek [89] with a hole for the fibers and 
disks; around the hole is an aluminum lip. A layer of 1/8" thick Styrofoam is 
placed over the fibers on the counter top; aluminum sheets 0.020" thick cover 
the bottom and top surfaces. An outer frame of Unistrut provides support 
for the counter. A piece of black molded plastic fits over the outside of the 
aluminum lip and covers the phototubes, cookies and fibers. 

The fibers are read out using two 1.5" 10-stage EMI [90] 9902KA phototubes 
mounted on the counters. The light yield varies depending on the distance 
from the phototube and the proximity to the counter edge. It is typically 30 
photoelectrons per PMT for hits near the PMTs and 18 for hits near the 
distant corners. 

The cosmic bottom counters complete the scintillator coverage of the central 
toroidal magnet. There are 132 counters, of two different designs. The forty- 
eight counters located on the outside of the center bottom B layer of PDTs 
(where there is no C layer) are nearly identical to the cosmic cap counters 
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described above. Some minor improvements were made in the placement of 
the edge fibers to increase the hght yield and the counter frames arc made from 
1/8" steel bent into U-shaped channels. The counters are suspended from the 
B-layer PDTs. 

The sixty-eight counters located on the undersides of the remaining B and 
C layers of the PDTs are similar to the cosmic cap counters except that the 
bottom counters have fewer fibers and they are placed in vertical, rather than 
horizontal, grooves. The grooves are approximately 6 mm deep and 6-10 cm 
apart. This distribution of fibers results in the same hght yield as the hori- 
zontal arrangement used for the cap counters. These counters use 1" -diameter 
MELZ [91] FEU-115M photomuhipher tubes. They are 12-stage PMTs with 
a 2 ns risetime and good quantum efficiency and uniformity. The PMTs are 
placed within 42-mm-diameter magnetic shields. The B-layer counters are sus- 
pended from the strong edges of the PDTs; the C-layer counters roll under- 
neath the C-layer PDTs with one set of wheels in a track to maintain the 
counter position. 

An important difference between the cosmic cap and cosmic bottom counters 
is that the bottom counters are positioned with their narrow dimension along 
(f) and their long dimension along t]. This orientation has better matching 
in 4) with the central fiber tracker trigger. The widths of the counters are 
approximately 4.5° in and they are as long or slightly longer than their 
respective PDTs are wide. Table 6 lists the location, number and size of the 
cosmic cap and bottom counters. 



6.2.3 A(f) scintillation counters 

The Ac/) scintillation counters cover the A-layer PDTs, those between the 
calorimeter and the toroid. They provide a fast detector for triggering on 
and identifying muons and for rejecting out-of-time backscatter from the for- 
ward direction. In-time scintillation counter hits are matched with tracks in 
the CFT in the Level 1 trigger (Section 9) for high-pr single muon and low-pr 
dimuon triggers. The counters also provide the time stamp for low-p^ muons 
which do not penetrate the toroid and thus do not reach the cosmic cap or 
bottom counters. 

An end view of the Acp counter layout is shown in Figure 42. The (p segmen- 
tation is approximately 4.5° which matches the central fiber tracker trigger 
(Section 9.1.3) segmentation. The longitudinal segmentation is 33.25" which 
provides the necessary time resolution and a match to the size of the PDTs; 
nine counters are required along the detector in the z direction. The nearly 
constant segmentation in (p is accomplished through the use of three sizes of 
counter: 14.46", 10.84", and 9.09" wide. The widest counters are located at 
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Table 6 

Location, number, and size of cosmic cap and bottom scintillation counters. All of 
the scintillator is 0.5" thick. 



Location 


JN umber 


TTT'IjI /• „1 \ 

Width (inches) 


T _ _ i_l /• „1 \ 

Length (inches) 




Uosmic cap top 


80 


25 


113 


EMI 


Cosmic cap upper sides 


80 


25 


108 


EMI 


Cosmic cap lower sides 


80 


25 


81.5 


EMI 


Central side B layer 


12 


35 


49 


EMI 


Central side B layer 


4 


35 


67 


EMI 


Central bottom B layer 


20 


22.375 


98.125 


EMI 


Central bottom B layer 


20 


15.75 


98.125 


xniv /TT 

EMI 


Central bottom B layer lap 


8 


18.5 


99.5 


EMI 


End bottom B layer 


20 


13.375 


91.062 


MELZ 


End bottom B layer 


12 


19.25 


91.062 


MELZ 


Central bottom C layer 


20 


22.062 


68.062 


MELZ 


Central bottom C layer 


16 


29.3 


68.062 


MELZ 



the corners of the detector, the narrowest at the center of each side. There is 
a gap at the bottom of the detector where the calorimeter support is located. 
The counters overlap an average of about 3% in to reduce the possibihty 
of muons passing through cracks. Along the length of the detector, the coun- 
ters are butted end-to-end with a small gap between each. There are 630 A(f) 
counters. 

The counters are made from Bicron 404A scintillator with G2 fiber embedded 
in vertical grooves [92] in a manner similar to the cosmic bottom counters 
described above. The grooves are about L75" apart and run along the length 
of each counter from the edge to the middle. Six fibers are spot glued into each 
groove and taper out of the groove at the middle of the counter. The fibers are 
routed to a MELZ FEU-115M photomultipher tube which is secured to the 
counter case. The counter and fibers are wrapped in a layer of Tyvek, followed 
by a layer of black TEDLAR [51]. The counter case is an aluminum box with 
welded corners. It provides mechanical protection, support of the PMT and 
counter mounts, and protection against light leaks. The counters are mounted 
on aluminum cross-members attached to steel brackets which are fastened to 
the edges of the A-layer PDTs. 

The A(f) counters operate in a magnetic field of 200-350 G due to the resid- 
ual magnetic field of the toroidal and solenoidal magnets. Magnetic shields 
made of 1.2-mm-thick //-metal and 6-mm-thick soft iron with a diameter of 
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5.67 m 




2.44 m 

Fig. 42. End view of the layout of the Acf) scintillation counters. The inset box 
shows an enlarged view of four counters. Azimuthal coverage is shown for seven 
of the counters. The bTimp on each counter represents the photomultiplier tube 
attached to the counter case. 

48 mm provide shielding from the fringe field (Section 6.3.2). The effect of the 
magnetic field on the PMT gain is less than 10% for any field direction. 

The performance of an ^40 prototype counter was studied using cosmic rays. 
The average muon signal corresponds to 50-60 photoelectrons. Comparison of 
the amplitudes of signals from the ends of the counters and from the center of 
the counter shows that the counters are uniform to ±7%. The timing resolu- 
tion of the counters is about 2 ns, due to photoelectron statistics, amplitude 
variation along the length of the counter, variation in the 2;-position of the 
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Fig. 43. Cross-sectional view of a mini drift tube. 

vertex, variation in the ^-position of the hit over the length of the counter, 
and variation of the time of collision. Different times-of-flight for particles at 
different polar angles are compensated for by varying cable lengths since the 
front-end electronics do not allow such timing adjustments. 



6.3 Forward muon system 

The layout of the forward muon system is shown in Figure 1. It covers 1.0 ^ 
\ri\ < 2.0 and consists of four major parts: the end toroidal magnets (Sec- 
tion 6.1, three layers of MDTs for muon track reconstruction, three layers 
of scintillation counters for triggering on events with muons, and shielding 
around the beam pipe. 

6.3.1 Mini drift tubes 

Mini drift tubes were chosen for their short electron drift time (below 132 ns), 
good coordinate resolution (less than 1 mm), radiation hardness, high seg- 
mentation, and low occupancy. The MDTs are arranged in three layers (A, B, 
and C, with A closest to the interaction region inside the toroidal magnet and 
C furthest away), each of which is divided into eight octants, as illustrated in 
Figure 40. A layer consists of three (layers B and C) or four (layer A) planes 
of tubes mounted along magnetic field lines (the field shape in the forward 
toroids is more "square" than "circular"). The entire MDT system contains 
48,640 wires; the maximum tube length is 5830 mm in layer C. Since the flux 
of particles drops with increasing distance from the beam line, the occupancy 
of individual tubes is the same within a factor of two over an entire layer. 

An MDT tube consists of eight cells, each with a 9.4 x 9.4 mm^ internal cross 
section and a 50 /xm W-Au anode wire in the center, see Figure 43. The tubes 
are made from commercially available aluminum extrusion combs (0.6 mm 
thick) with a stainless steel foil cover (0.15 mm thick) and are inserted into 
PVC sleeves. They are closed by endcaps that provide accurate positioning of 
the anode wires, wire tension, gas tightness, and electrical and gas connections. 
The anode wires are supported by spacers; the unsupported wire length never 
exceeds 1 m. 
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Distance to anode wire (mm) 



Fig. 44. Timc-to-distance relationship for a mini drift tube. The points labeled 
degrees and 45 degrees are calculated using GARFIELD. The crosses indicate 
measurements done at 0°. 

The MDT system uses a CF4-CH4 (90%-10%) gas mixture. It is non-flammable, 
fast, exhibits no radiation aging, and has a wide operational plateau. The max- 
imum drift time for tracks that are perpendicular to the detector plane is 40 ns; 
for tracks inclined at 45°, the maximum drift time is 60 ns. Figure 44 shows 
the time-to-distance relationship for inclinations of 0° and 45° calculated using 
GARFIELD [93] and for test beam data. 

Negative high voltage is applied to the cathode (—3200 V); the anode wire is 
grounded at the amplifier. Each anode wire is connected to an amplifier and 
a discriminator located as close as possible to the detector. Each amplifier 
discriminator board (ADB) contains 32 channels and detects signals with a 
2.0 jiA threshold. Output logical differential signals from the ADB are sent to 
digitizing electronics which measure the signal arrival time with respect to the 
beam crossing with an accuracy of 18.8 ns (1.9 mm). This large time bin (equal 
to the Tcvatron RF bucket size since the main accelerator clock is 53 MHz) 
limits the coordinate resolution of the MDTs and was selected to reduce the 
cost of almost 50,000 TDCs (time-to-digital converters). Hit information is 
sent to the trigger and data acquisition systems; the data acquisition system 
also receives drift times. 

The efficiency of the MDTs is 100% in the active area of the cells for tracks 
that are perpendicular to the MDT plane. The overall plane efficiency is less, 
due to the wall thickness and PVC sleeves, and is approximately 95%. The 
MDT efficiency is reduced near the wire-support spacers as well. Although 
each spacer is only 5 mm wide along the wire, the degradation in the electric 
field causes the efficiency to drop to approximately 20% for about 10 mm 
along the wire. An additional inefficiency of about 5% is caused by the tube 
endcaps and gaps between octants for mounting, gas connections, and high 
voltage and signal cables. 

The momentum resolution of the forward muon spectrometer is limited by 
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multiple scattering in the toroid and the coordinate resolution of the tracking 
detector. Although the MDT coordinate resolution measured in a test beam 
is about 350 /^m, the 18.8 ns time bin of the digitizing electronics leads to a 
resolution of about 0.7 mm per hit. The standalone momentum resolution of 
the forward muon system is approximately 20% for muon momentum below 
40 GeV/c. The overall muon momentum resolution is defined by the central 
tracking system for muons with momentum up to approximately 100 GeV/c; 
the forward muon system improves the resolution for higher momentum muons 
and is particularly important for tracks with 1.6 < < 2.0, i.e. those which 
do not go through all layers of the CFT. 



6.3.2 Trigger scintillation counters 

The muon trigger scintillation counters are mounted inside (layer A) and out- 
side (layers B and C) of the toroidal magnet (Figure 1). The C layer of scin- 
tillation counters is shown in Figure 45. Each layer is divided into octants 
containing about ninety-six counters. The segmentation is 4.5° and matches 
the CFT trigger sectors. The t] segmentation is 0.12 (0.07) for the first nine 
inner (last three) rows of counters. The largest counters, outer counters in the 
C layer, are 60 x 110 cm^. The B and C layers have geometries similar to that 
of the A layer, but hmited in places by the collision hall ceiling and fioor. 

The counter design was optimized to provide good time resolution and ampli- 
tude uniformity for background rejection, high muon detection efficiency, and 
reasonable cost for the production of nearly five thousand counters. A typical 
counter is shown in Figure 46. The counters are made of 0.5" Bicron 404A 
scintillator plate cut in a trapezoidal shape. Kumarin 30 [94] WLS bars are at- 
tached to two sides of the plate for light collection. The bars are 4.2 mm thick 
and 0.5" wide and bent at 45° to transmit light to a 1" phototube. The pho- 
totubes are fast green-extended phototubes, FEU-115M, from MELZ. They 
have a quantum efficiency of 15% at 500 nm and a gain of about 10^. 

The sides of scintillator plates where the WLS bars are attached were left 
unpolished after milling. The unpolished sides result in a larger number of 
photoelectrons and better uniformity than pohshed sides do and cost less [92] . 
The scintillator and WLS bars are wrapped in Tyvek for better light collection 
and black paper for light tightness. The wrapped counters are placed in 1-mm- 
thick aluminum containers with stainless steel transition pieces for connection 
of the phototube assembly. 

The fringe magnetic field due to the solenoidal and the toroidal magnets 
reaches 300 G in the region where the A-layer phototubes are located (Fig- 
ure 23). To reduce the field in the area of the phototubes to approximately 
1 G, they are placed in 48-mm-diameter magnetic shields made of 1.2-mm- 
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Fig. 45. Photograph of the C layer of muon trigger scintiUation counters of the 
forward muon system. 

thick mu-metal and 3- or 6-mm-thick soft iron. Since the field near the A layer 
is larger, the shields there use 6 mm of iron. Those for the B and C layers use 
3 mm of soft iron. The effect of the magnetic field on the phototube signal is 
less than 10% for fields up to 350 G for the 6-mm-thick shields for any field 
orientation with respect to the phototube. 

The performance of three counters of different sizes was studied in a 125 GeV/c 
muon test beam. Figure 47 shows the dependence of the counter efficiency 
and time resolution as a function of high voltage for three counters: "large" 
60 X 106 cm^, "typical" 24 x 34 cm^, and "small" 17 x 24 cm^. A single 
discrimination threshold of 10 mV was used for these measurements. Time 
resolution of better than 1 ns and detection efficiency above 99.9% can be 
achieved at appropriate high voltage settings for all counter sizes. The non- 
uniformity of the counter response was measured by irradiating counters at 
different points using a ^'^Sr source and checked via cosmic ray studies. For 
all counter sizes, the rms non- uniformity is less than 10%. Cosmic ray muons 
were used to determine the average number of photoelectrons detected in the 
counters. The largest counters have an average of 61 detected photoelectrons; 
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Fig. 46. Design of a scintillation counter for the forward muon trigger system. Di- 
mensions are in mm. 

the smallest counters give about three times as many photoelectrons. 

Phototube signals are sent to 48-channel VME-based scintillator front-end 
(SFE) cards. Input 1:1 transformers at the SFE card isolate the SFE from DC 
noise picked up between the phototubes and electronics modules which are 
located about 10 m apart. After amplification, the signals are sent to a 10-bit 
ADC and to a discriminator. Discriminated and gated signals are passed to the 
Level 1 trigger system (Section 9.1) and to the SFE TDC with a 1.03 ns time 
bin. After digitization, amplitude and time information is sent to the Level 2 
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Fig. 47. Time resolution and detection efficiency of muon trigger scintillation coun- 
ters. Large counters are 60 x 106 cm^; typical counters are 24x34 cm^; small counters 
are 17 x 24 cm^. 

trigger system (Section 9.2) and to the data acquisition system (Section 10). 
The amphtude is measured in one out of sixteen channels per event for counter 
response monitoring. 



6.3.3 Shielding 

Three sources contribute to non-muon background in the central and forward 
muon systems: i) scattered proton and antiproton fragments that interact with 
the end of the calorimeter or with the beampipe produce background in the 
central and forward A layer; ii) proton and antiproton fragments interacting 
with the Tevatron low-beta quadrupole magnets produce hits in the B and 
C layers of the forward muon system; and Hi) beam halo interactions from 
the tunnel. Shielding installed in the accelerator tunnel during Run I [95] sig- 
nificantly reduced the background from beam halo. New shielding has been 
installed for Run II to reduce the background due to proton and antipro- 
ton remnants. Reduction in backgrounds along with the use of radiation-hard 
detectors helps ensure the long-term, reliable operation of the muon system. 

The shielding consists of layers of iron, polyethylene, and lead in a steel struc- 
ture surrounding the beam pipe and low-beta quadrupole magnets. Iron is 
used as the hadronic and electromagnetic absorber due to its relatively short 
interaction (16.8 cm) and radiation (1.76 cm) lengths and low cost. Polyethy- 
lene is a good absorber of neutrons due to its high hydrogen content. Lead is 
used to absorb gamma rays. 

The position of the shielding is shown in Figure 1. It extends from the end 
calorimeter cryostat, through the end toroid magnet, to the wall of the collision 
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hall. It consists of three rectangular cross section pieces that arc 84" , 85" and 
60" long, starting at the calorimeter and moving away from the detector center. 
The piece closest to the toroid has a 20" square hole at the center followed 
by 16" of iron, 6" of polyethylene, and 2" of lead. The two outer pieces are 
identical except that the hole is 25" square followed by 20" of iron. The most- 
forward section is split vertically down the center so that it can be moved out 
of the way when the end toroid magnet is repositioned for access to the central 
parts of the detector. Figure 45 shows the shielding in the "open" position. 

Monte Carlo studies based on MARS code [96,97] show that the shielding pro- 
vides a factor of 50-100 reduction in the energy deposition in muon detector 
elements. Reduction of backgrounds reduces the occupancy and detector ag- 
ing, and provides almost background-free muon triggering and reconstruction. 
MARS Monte Carlo predictions of the number of hits in the muon detectors 
agree with the observed occupancies within 50%. 



6.4 Muon scintillation counter monitoring 

All muon scintillation counters are calibrated and monitored using an LED- 
based pulser system [98]. Given the large number of counters involved, it is 
difficult to use cosmic ray and beam muons to check the timing and do the 
PMT gain calibration quickly. The LED system allows us to find dead PMTs, 
isolate the behavior of the PMTs from the front-end electronics, adjust the 
relative timing between channels, set initial PMT gains, monitor PMT gains, 
and track timing changes. 

A pulser triggers an LED driver board that drives four LEDs embedded in 
an acrylic block. The light is further mixed in two acrylic mixing blocks. The 
upstream side of each block is frosted by sand-blasting; the sides of the blocks 
are polished to maximize total internal reflection. The light is then distributed 
to an array of clear optical flbers embedded in a fourth acrylic block. These 
light distribution fibers are connected to fibers which are butted up to each 
PMT. To match the peak wavelengths and emission spectra of the wavelength- 
shifting fibers used in the counters, different LEDs are used for the central 
and forward counters. In the central region, blue-green NSPE510S LEDs from 
Nichia America Corp. are used; in the forward region, blue NSPB320BS LEDs, 
also from Nichia America Corp., have been installed. The clear fibers are 
Hewlett Packard HFBR-500 optical fibers. 

The light intensity of the LEDs is monitored using a PIN diode (Hamamatsu 
S6775) mounted at the downstream end of the first mixing block; this works 
well because the mixing blocks evenly distribute the light to the fiber array. 
As long as the PIN diode is stable over time, variation in the gain of the PMTs 
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Fig. 48. Results from the forward muon system monitoring by the LED cahbration 
system over one and one-half years; the smooth curves are Gaussian fits to the 
data, a) shows the LED amplitude ratio, b) shows the absolute difference in the 
LED timing. 



can be measured independently of variation in the light output of the LEDs. 

Figure 48 shows results from the forward muon system monitoring between 
July 2001 and January 2003. The ratio of the LED amplitudes is stable within 
4% with a standard deviation of about 7%. The timing stabihty over this 
interval shows a peak stability within 0.2 ns with a standard deviation of 
about 0.43 ns. The typical time resolution of counters during data taking is 
2 ns, so stability is not a major factor in the overall time resolution of the 
system; photoelectron statistics, beam spot size, and bunch timing are all 
more important. 
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7 Forward proton detector 



The forward proton detector (FPD) [99] measures protons and antiprotons 

scattered at small angles (on the order of 1 mrad) that do not impinge upon 
the main D0 detector. During Run I, such diffractive events were tagged using 
a rapidity gap (the absence of particles in a region of the detector), however 
a forward particle detector is necessary for access to the full kinematics of the 
scattered particle. 

7.1 The detector 

The FPD consists of a series of momentum spectrometers that make use of 
accelerator magnets in conjunction with position detectors along the beam 
line. The position detectors operate a few millimeters away from the beam and 
have to be moved out of the beamline during injection of protons or antiprotons 
into the accelerator. Special stainless steel containers, called Roman pots [100], 
house the position detectors, allowing them to function outside of the ultra- 
high vacuum of the accelerator, but close to the beam. The scattered p or p 
traverses a thin steel window at the entrance and exit of each pot. The pots 
are remotely controlled and can be moved close to the beam during stable 
conditions. 

The Roman pots are housed in stainless steel chambers called castles. The 
FPD consists of eighteen Roman pots arranged in six castles. The castles are 
located at various distances from the D0 interaction point and in locations 
that do not interfere with the accelerator. The arrangement of the FPD is 
shown in Figure 49. Four castles are located downstream of the low beta 
quadrupole magnets on each side of the collision point: two on the p side (PI 
and P2) and two on the p side (Al and A2). Each of these quadrupole castles 
contains four Roman pots arranged to cover most of the area around the beam. 
Two castles (Dl and D2) are located on the outgoing p side after the dipole 
magnet. Each of these dipole castles contains only one Roman pot. There are 
nine spectrometers: the two dipole castles form one, and on each side of the 
interaction region the two up, two down, two in, and two out pots are paired 
to form the other eight (Figure 49). 

7.1.1 The position detector 

The construction of the position detectors is illustrated in Figure 50. Each 
detector is made of 0.8-mm-thick double-clad square scintillating fibers (Bicron 
BCFIO [85]) bundled in groups of four parallel fibers, forming a scintillating 
structure measuring 0.8 mm x 3.2 mm. One end of the detector element 
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Fig. 49. FPD layout. Quadrupole castles are designated with a leading P or A when 
placed on the p side or the p side, respectively: the number designates the station 
location; while the final letter indicates pot potition (U for up, D down, I in, O 
out). Dll and D2I are dipole castles. 




Fig. 50. Detector fibers and the MAPMT. 

is aluminized (about a 3-/im-thick layer) to increase the light yield and the 
other end of each scintillating fiber is spliced to a double-clad clear fiber of 
square cross section (Bicron BCF98) with the same dimensions. The use of 
square fibers gives an increase of about 20% in light output compared to round 
fibers. The scattered p or p goes through 3.2 mm of scintillating material. 
The four clear fibers take the light of one element to a single channel of 
the Hamamatsu H6568 16-channel multi-anode photomultiplier (MAPMT), 
yielding approximately ten photoelectrons. 

As shown in Figure 50, each detector consists of six planes in three views 
{u, X and v) to minimize ghost hit problems and to reduce reconstruction 
ambiguities. Each view is made of two planes {u — u', x — x', and v — v'), 
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the primed layers being offset by two-tfiirds of a fiber witli respect to tlie 
unprimed layers. The u and v planes are oriented at ±45° with respect to 
the horizontal bottom of the detector, while the x plane is at 90°. There are 
twenty channels in each layer of the u and v planes and sixteen channels in 
each of the x layers. There are 112 channels (each with four fibers) per detector 
giving a total of 2016 channels in the eighteen Roman pots. The readout of 
each detector requires seven MAPMTs and includes a trigger scintillator read 
out by a fast photomultiplier tube (Philhps XP2282 [101]). The FPD uses 
CFT electronics (Section 2.2.5) for the scintillating fiber detector read out, 
luminosity monitor electronics (Section 8) for the trigger read out, and the 
muon LED system for calibration (Section 6). The trigger manager designed 
for the muon system incorporates this information in making a Level 1 trigger 
decision on FPD tracks (Section 9.1.5). 

7.1.2 The castle 

Figure 51 shows an FPD quadrupole castle. It has four arms (dipole castles 
are similar, but have just one arm), each containing a Roman pot housing a 
detector. The castles are made of 316L stainless steel and, due to the ultra- 
high vacuum necessary in the interior of the castles, all parts were cleaned with 
demineralized water and alkaline detergent in an ultrasound bath and dried 
with a hot air jet before being TIG welded. The quadrupole castles (dipole 
castles are not in ultra-high vacuum) are baked at 150° C when the vacuum 
has been broken. A set of hot cathode and convection Pirani-style sensors 
monitors the vacuum in the chamber. Each castle has an associated ion pump 
to provide the ultra-high vacuum. 

The castle sits on a stand that allows adjustment of its position in all directions 
over a range of 15 mm with an accuracy of 0.1 mm. The pot is connected to 
a driving system that makes it possible to move it perpendicularly to the 
beam. A 200-;Lim-thick window separates the detector (inside the pot) from 
the castle ultra-high vacuum. The system is operated by a step motor and 
a set of reduction gears allows pot motion with a precision of approximately 
5 /im. A system of cylindrical and conical bearings allows adjustment of the 
pot alignment and a linear variable differential transducer (LVDT) monitors 
the pot position. 



7.2 Acceptance 

The FPD acceptance is maximized by minimizing the distance between the 
detectors and the beam axis. This distance is limited primarily by interaction 
with the beam halo which increases as the pots are inserted closer to the beam. 
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Fig. 51. FPD quadrupole castle. 



FPD acceptance is determined as a function of t, the four-momentum transfer 
squared of the scattered proton or antiproton, and ^ = I — Xp where Xp is 
the fractional longitudinal momentum of the scattered particle. For the dipole 
spectrometer, the acceptance is highest for \t\ % 2 GeV^/c^, 0.04 ^ ^ ^ 0.08 
and extends to \t\ ^4.3 GeV^/c^, 0.018 < { < 0.085 (coverage is incomplete). 
The acceptance in the quadrupole spectrometers covers most of the region 
0.6 ^4.5 GeVVc^e^0.1. 

For elastic events, both particles must be detected by diagonally opposite spec- 
trometers with no activity detected in any other D0 subdetector. A sample of 
elastic events collected during special runs was used to measure the position 
resolution of the FPD by comparing the x coordinate determined by combin- 
ing information from the u and v planes to the x coordinate from the x plane. 
This process gives a resolution of 130 //m. 



8 Luminosity monitor 

The primary purpose of the luminosity monitor (LM) is to determine the 
Tevatron luminosity at the D0 interaction region. This is accomplished by 
detecting inelastic pp collisions with a dedicated detector. The LM also serves 
to measure beam halo rates and to make a fast measurement of the z coordi- 
nate of the interaction vertex. 
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Fig. 52. Schematic drawing showing the location of the LM detectors. 



Fig. 53. Schematic drawing showing the geometry of the LM counters and the 
locations of the PMTs (solid dots). 

8.1 The detector 



The LM detector consists of two arrays of twenty-four plastic scintillation 
counters with PMT readout located at 2; = ±140 cm (Figure 52). A schematic 
drawing of an array is shown in Figure 53. The arrays are located in front of 
the end calorimeters and occupy the radial region between the beam pipe and 
the forward preshower detector. The counters are 15 cm long and cover the 
pseudorapidity range 2.7 < \ri\ < 4.4. 

Scintillation light produced in the Bicron BC-408 scintillator is detected by 
Hamamatsu [86] R5505Q fine mesh PMTs. Due to space constraints and the 
characteristics of the PMTs, they are mounted on the faces of the scintillators 
with the axes of the PMTs parallel to the z axis. They have no magnetic 
shielding, and their gain is reduced by a factor of about 30 when the solenoidal 
magnet is turned on due to the approximately 1 T magnetic field in this 
region [102]. The time-of-flight resolution for the counters is about 0.3 ns, 
with the dominant contribution to the resolution being the variation in light 
path length for particles striking different locations on the scintillator. 
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Radiation damage is a concern for detectors located this close to the beams. 
Much of the radiation dose seen by these detectors comes from the pp collision 
products and is thus unavoidable. The PMTs are exposed to a radiation flux 
of about 25 krad/fb"^, which is sufficient to cause darkening of the borosihcate 
glass window typically used for PMTs. The R5505Q PMTs have fused sihca 
(quartz) windows which are largely immune to radiation damage [86]. The 
radiation fiux increases rapidly with decreasing radius, reaching a level of 
approximately 300 krad/fb~^ at the innermost scintillator edge. Based on the 
radiation damage study in Ref. [103], modest 10%) light loss is expected 
for the innermost scintillator edge after 3 fb~^. 

The scintillation counters are enclosed in light-tight enclosures, with each en- 
closure holding twelve counters. Preamplifiers inside the enclosures amplify 
the PMT signals by a factor of five. The fused sihca PMT windows are much 
more permeable to helium gas than borosihcate glass [104]. To avoid damage 
from the widely fiuctuating helium concentration present in the collision hall, 
the enclosures are purged with dry nitrogen. 

For accurate timing of the PMT signals, low-loss cables [105] are used to bring 
the signals from the detector to the digitization and readout electronics. The 
signals are equalized in time and split into two paths. On one path, currently 
in use for luminosity measurements, analog sums are formed from the PMT 
signals for each of the two arrays, which are then timed using a digital TDC to 
identify pp collisions [106]. On the other path, which is an upgrade currently 
being installed, two types of custom VME boards provide the required signal 
processing. Six LM-TDC boards are used to digitize the time and charge for 
each PMT and apply charge-slewing corrections to generate fully calibrated 
time-of-fiight measurements. A single LM-VTX board utilizes the measure- 
ments made on the LM-TDC boards to calculate the average time for each 
counter array and the z coordinate of the interaction vertex. 



8.2 Luminosity determination 



The luminosity £ is determined from the average nuinber of inelastic coUisions 
per beam crossing Nlm measured by the LM: C — ^^^^ where / is the beam 
crossing frequency and aiM is the efi^ective cross section for the LM that takes 
into account the acceptance and efficiency of the LM detector [107]. Since 
Nlm is typically greater than one, it is important to account for multiple pp 
collisions in a single beam crossing. This is done by counting the fraction of 
beam crossings with no collisions and using Poisson statistics to determine 
Nlm- 

To accurately measure the luminosity, it is necessary to distinguish pp in- 
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teractions from the beam halo backgrounds. We separate these processes by 
making precise timc-of-flight measurements of particles traveling at small an- 
gles with respect to the beams. We first assume that particles hitting the LM 
detector originate from a pp interaction and estimate the z coordinate of the 
interaction vertex from the difference in time-of-flight: z^ — — t+) 
where t+ and t_ arc the timcs-of-flight measured for particles hitting the LM 
detectors placed at ±140 cm. Beam-beam collisions are selected by requiring 
\zy\ < 100 cm, which encompasses nearly all pp collisions produced by the 
Tevatron (a^ ^ 30 cm). Beam halo particles travehng in the ±i direction will 
have Zy ~ ^140 cm, and are eliminated by the \zy\ < 100 cm requirement. 

Level 1 triggers (Section 9.1) are grouped together so that they have common 
deadtime, i.e., common sources of enable, disable, and readout. This allows the 
readout to be partitioned so that different triggers may read out independent 
portions of the detector. The luminosity associated with each trigger takes 
into account the instantaneous luminosity, the deadtime, and losses in the 
data acquisition system. 

The luminosity block is the fundamental unit of time for the himinosity mea- 
surement. Each block is indexed by the luminosity block number (LBN), which 
monotonically increases throughout Run II. The LBN is incremented upon run 
or store transitions, TFW or SCL initialization, by request, or after 60 seconds 
have elapsed. The time period is short enough so that the instantaneous lu- 
minosity is effectively constant during each luminosity block, introducing neg- 
ligible uncertainty into the measurement of the luminosity due to the width 
of the time slice. Raw data files are opened and closed on LBN boundaries. 
Luminosity calculations are made independently for each LBN and averaged 
over the luminosity block. 



8.3 Luminosity data acquisition system 



The luminosity data acquisition system (LDAQ) is a stand-alone data acquisi- 
tion system running on the online cluster. The LDAQ was designed to collect 
sufficient data to measure, verify, and monitor the luminosity delivered to and 
used by D0. The LDAQ connects to the following systems: LI trigger frame- 
work (Section 9.1.1), accelerator controls system, D0 controls system (Sec- 
tion 11), Level 3 (both ScriptRunner and DAQ, Sections 9.3 and 10), COOR 
(Section 10.2), and the datalogger (Section 10). Data from different sources 
are correlated, loaded into a database, and used for luminosity calculations. 
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Fig. 54. Overview of the D0 trigger and data acquisition systems. 
9 Triggering 



With the increased luminosity and higher interaction rate dehvered by the 
upgraded Tevatron, a significantly enhanced trigger is necessary to select the 
interesting physics events to be recorded. Three distinct levels form this new 
trigger system with each succeeding level examining fewer events but in greater 
detail and with more complexity. The first stage (Level 1 or LI) comprises a 
collection of hardware trigger elements that provide a trigger accept rate of 
about 2 kHz. In the second stage (Level 2 or L2), hardware engines and embed- 
ded microprocessors associated with specific subdetectors provide information 
to a global processor to construct a trigger decision based on individual ob- 
jects as well as object correlations. The L2 system reduces the trigger rate by 
a factor of about two and has an accept rate of approximately 1 kHz. Candi- 
dates passed by LI and L2 are sent to a farm of Level 3 (L3) microprocessors; 
sophisticated algorithms reduce the rate to about 50 Hz and these events are 
recorded for offline reconstruction. An overview of the D0 trigger and data 
acquisition system is shown in Figure 54. A block diagram of the LI and L2 
trigger systems is shown in Figure 55. 

The trigger system is closely integrated with the read out of data, as illustrated 
in Figure 54. Each event that satisfies the successive LI and L2 triggers is fully 
digitized, and all of the data blocks for the event are transferred to a single 
commodity processor in the L3 farm. The LI and L2 buffers play an important 
role in minimizing the experiment's deadtime by providing FIFO storage to 
hold event data awaiting a Level 2 decision or awaiting transfer to Level 3. 

The overall coordination and control of D0 triggering is handled by the COOR 
package (Section 10.2) running on the online host. COOR interacts directly 
with the trigger framework (for LI and L2 triggers) and with the DAQ super- 
vising systems (for the L3 triggers). The data acquisition system responsible 
for the data flow of the fully digitized event into L3 is described in Section 10. 
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Fig. 55. Block diagram of the D0 LI and L2 trigger systems. The arrows show the 
flow of trigger-related data. 



9.1 The Level 1 trigger 



LI is implemented in specialized hardware and examines every event for in- 
teresting features. The calorimeter trigger (LlCal) looks for energy deposition 
patterns exceeding programmed limits on transverse energy deposits; the cen- 
tral track trigger (LICTT) and the muon system trigger (LlMuon) compare 
tracks, separately and together, to see if they exceed preset thresholds in trans- 
verse momentum. The LI forward proton detector trigger (LIFPD) is used to 
select diffractively-produced events by triggering on protons or antiprotons 
scattered at very small angles. 

All events awaiting LI trigger decisions are pipelined and thus make minimal 
contributions to the deadtime. In order to participate in the trigger decision, 
the LI trigger decision must arrive at the trigger framework in 3.5 /xs or less. 
The rate of LI trigger accepts is limited by the maximum readout rates of the 
participating subsystems and by a desire to minimize the deadtime associated 
with the readout. 



9.1.1 Trigger framework 

The trigger framework (TFW) gathers digital information from each of the 
specific LI trigger devices and chooses whether a particular event is to be ac- 
cepted for further examination. In addition, it coordinates various vetoes that 
can inhibit triggers, provides the prescaling of triggers too copious to pass on 
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without rate reduction, correlates the trigger and readout functions, manages 
the communication tasks with the front-end electronics and the trigger control 
computer (TCC), and provides a large number of scalers that allow accounting 
of trigger rates and deadtimes. 



The TFW for Run II is built out of 9U 400 mm cards housed in customized 

VME crates. All of the cards in the TFW use the same general circuit board, 
the same front and rear panel layout, and the same connectors and make ex- 
tensive use of field programmable gate array (FPGA) technology to implement 
different functions. A block diagram of the principal functions of the TFW is 
shown in Figure 56. 

The functions of the TFW are summarized below: 

• It receives up to 256 "AND-OR" terms (bits) from various parts of the 

experiment, which are used to form specific triggers. 

• Up to 128 specific triggers can be programmed using the AND-OR terms. 
The "or" of all of these triggers determines whether or not a given cross- 
ing had a valid trigger. These are called "physics" triggers. Each of the 
128 specific triggers has a separate programmable "beam condition" trigger 
associated with it. For a trigger to occur, both the "physics" trigger and 
"beam condition" conditions must be satisfied. 

• All the resources, including the triggers, are programmed from COOR (Sec- 
tion 10.2) via text-based commands interpreted in the TCC which then 
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configures the TFW. 

• Any trigger can be prescaled under program control. The TFW manages 
the prescale ratios. 

• At the level of data acquisition, the detector is divided into subsections or 
groups of subsections served by a single serial command link (SCL) called 
geographic sectors. Typical geographic sectors are detector front-ends but 
other systems such as the TFW readout are also geographic sectors. The 
TFW supports up to 128 geographic sectors and any specific trigger can be 
programmed to request digitization and readout of any subset of the 128 
geographic sectors. This permits a partitioning of the data acquisition sys- 
tem into several separate systems, which is particularly useful during setup, 
installation, and calibration. Each geographic sector receives an LI Accept 
signal from the TFW over the SCL, followed by an L2Accept or L2Reject 
from the L2 global processor. 

• The TFW can be programmed so that only particular bunch crossings con- 
tribute to a given trigger. Beam crossing numbers and LlAccept numbers 
provide a unique identifier for events. 

• The TFW provides all of the scalers needed to count the triggers as well as 
scalers to monitor the live time of combinations of these triggers (known as 
exposure groups). 

• The TFW offers an extensive menu of lower level and specialized commands 

for diagnosis of the trigger hardware. 

• TFW scalers and registers are accessed through the TCC to perform trigger 
system programming, diagnostics, and monitoring. 

• During Run I, elements of the LI trigger could only be ANDed to give a 
specific trigger. For Run II, the capability to allow both ANDs and ORs 
of trigger terms has been added to the TFW, using resident firmware. The 
resulting combinations are called pseudo-terms, since they are not formed 
in hardware. The pseudo-terms have the ability either to sharpen trigger 
turn-on curves, or to reduce combinatorial backgrounds and thus reduce 
the rate of low-pr triggers. 

9.1.2 Level 1 calorimeter trigger 

The underlying architecture of the LI calorimeter trigger for Run II is the 
same as it was for Run I [108]. There are, however, a number of improvements 
in the way the data are received by the trigger and the way the results are 
extracted. 



9.1.2.1 Summary of operational principles The trigger inputs consist 
of electromagnetic (EM) and hadronic (H) trigger tower energies made up from 
sums in depth and transverse coordinates (Ar/ x = 0.2 x 0.2) of fast analog 
pickoffs from the BLS circuits. There are 12 EM towers and 1280 H towers: 
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forty slices in rj, covering the region |?7| < 4, and thirty-two slices in 0, covering 
the full 27r of the azimuth. The tower energies are converted to Ex on input, 
and have pedestals subtracted and energy scales adjusted if necessary. The 
variables used in trigger calculations are actually the EM transverse energies 
and the total transverse energies (EM+H) formed by adding the corresponding 
EM and H towers. The triggers available for use in the experiment include: 

• Global variables 

There are two global variables: EE't, the sum of all tower EtS, with four 
thresholds; and ^-r, again with four thresholds. 

• Local variables 

Each EM tower and each EM+H tower is compared to four programmable 
Et threshold sets. A given threshold set could contain different values of Et 
for each tower although in practice they are all set to the same value. A bit 
is set if a tower exceeds its reference value. (A feature vetoing the EM tower 
if its corresponding EM+H tower exceeds a programmed reference value is 
available but has never been used.) The number of EM towers and EM+H 
towers exceeding their thresholds in a given reference set is counted and 
trigger bits are generated if this count exceeds any of several programmed 
count limits. We chose to use two such count limits for EM towers and four 
for EM+H towers. 

• Large tiles 

Since the trigger towers are small relative to the size of jets, we use some 
of the partial Et sums needed for the calculation to trigger on jets. 
Conveniently available are sums covering 4x8 trigger towers in 77 x 0, 
corresponding to an area of 1.28 in this space. For generating trigger bits, 
four reference sets are available with two count thresholds for each set but 
only for EM+H and not for EM-only large tiles. 



9.1.2.2 Modifications for Run II A number of changes were made to 
the calorimeter trigger in anticipation of the higher crossing rates and lumi- 
nosities expected during Run H. 

• Signal receiver electronics 

In Run I, the conversion of the BLS energy signals to properly-scaled Et 
values was done on the calorimeter trigger front-end (CTFE) cards by a 
network of hard-wired precision resistors, making gain adjustments difficult. 
For Run II, we bypassed this problem by building new front-end receiver 
cards capable of gain adjustment up to a factor of two for each channel under 
computer control. This change also allowed us to add circuitry to decrease 
the trigger signal rise times to be compatible with the 132 ns accelerator 
bunch spacing originally anticipated for Run II. Each card processes the 
signals from two trigger towers and two such cards were needed to upgrade 
each Run I CTFE card. 
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• Readout electronics 

To speed up the readout of LI calorimeter trigger data and therefore improve 
the LI trigger accept rate, the old readout system of two eight-bit buses 
was replaced with ten sixteen-bit buses. With this improvement, the LlCal 
accept rate can exceed 10 kHz. 

• Trigger coverage 

Trigger tower energy data are read out for the full calorimeter. Because of 
signal to noise considerations, only the trigger towers for |?7| < 3.2 are used 
for triggering. In addition to the calorimeter trigger towers, ICD towers are 
embedded in the data as well. 



9.1.3 Level 1 central track trigger 

The LICTT [109] reconstructs the trajectories of charged particles using fast 
discriminator data provided by three scintillator-based detectors: the central 
fiber tracker (Section 2.2) and the central and forward preshower detectors 
(Section 4). Data processed by the LICTT are used to make LI trigger de- 
cisions, otherwise known as trigger terms. While the LICTT is optimized for 
making fast LI trigger decisions, the electronics also store more-detailed event 
data (e.g. sorted hsts of tracks and preshower clusters) for later L2/L3 readout, 
or for use as seeds by other D0 trigger systems. 



9.1.3.1 Overall system design The input to the LICTT system con- 
sists of the discriminator bits generated on the AFE boards every 132 ns. 
These discriminator bits are sent from the AFE boards over point-to-point low 
voltage differential signal (LVDS) hnks to chains of digital front-end (DFE) 
boards. Each of the DFE boards in the LICTT system is built using a common 
6 U X 320 mm motherboard that supports one or two daughterboards. Cur- 
rently there are two different daughterboard layouts with different sizes and 
numbers of FPGAs. A transition board allows a DFE motherboard to drive 
LVDS, fiber optic, and coaxial copper links. LlCTT-specific protocols define 
the data format for communication between all DFE boards and consumers. 
This hardware modularity, when coupled with the flexibility of FPGAs, en- 
ables application-specific functionality to be located in firmware, minimizing 
the number of unique DFE boards in the system. 

The LICTT system comprises three subsystems: CFT/CPS axial, CPS stereo, 
and EPS. Of these, the CFT/CPS axial and EPS subsystems provide LI trigger 
terms to the trigger framework. All three subsystems participate in L2/L3 
readout by sending track and cluster lists to various preprocessor and readout 
crates. 



97 



80 




CFT / CPS 
Axial Detector 
40,9S0 Rbers 



— L3 Readout 

20 80 





AFE 




Mixer 




DFEA 









UfL2 



^ L1 Muor 

L2 Trigger 6 



L2 



STOV 



GTcy _^ L2 Silicon 
S^^*Trigg8^ 



CTOC 



L2 



CTQD 



L1 



"1 



cm 



L1 



L2CPS 
Preprocessor 
L2CFT 
Preprocessor 

TYIgger 
Frarrawork 

L3 Readout 



Fig. 57. The CFT/CPS axial components of tlie LICTT system. Tlic numbers in 
the top left corners of the boxes indicates the number of board of each type. 



9.1.3.2 LICTT subsystems 



• CFT/CPS axial 

The CFT/CPS axial subsystem (Figure 57) is designed to provide triggers 
for charged particles with px > 1.5 GeV/c. In addition to finding tracks, it 
must also find CPS clusters, match tracks to clusters, and report the overall 
occupancy of the CFT axial layers. Significant resources are allocated for 
triggering on isolated tracks. The CFT/CPS axial system also supplies the 
LlMuon and L2STT systems with lists of seed tracks, and sends track and 
cluster information to the L2CTT and L2PS preprocessors (Figure 55). 

For mechanical reasons, the CFT and CPS axial fibers are grouped by 
cyhnder layer before routing to the AFE boards. However, the track finder 
algorithms require the fiber information to be arranged in 4.5° sectors in the 
transverse plane (Figure 58). Furthermore, each track- finder daughterboard 
must receive information from each of its neighboring sectors to find tracks 
that cross sector boundaries. A set of twenty mixer boards [110] handles 
this data reorganization and duplication. After data duplication, the mixer 
output data rate is a constant 475 Gbits/s. Total latency through the mixer 
system is 200 ns. 

From the mixer system, the properly organized discriminator bits arc sent 
to the first tier of DFE boards. This first tier consists of forty motherboards, 
with each motherboard having two daughterboards (DFEAs). Each DFEA 
daughterboard unpacks the CFT data and compares the fiber hits against 
approximately 20,000 predefined track equations. To minimize latency, this 
operation is performed in parallel using combinatorial logic in FPGAs. De- 
vice resources are balanced by grouping track equations into four pt bins, 
with each px bin corresponding to a single FPGA, as shown in Table 7. 

Each track-finder FPGA outputs the six highest-pr tracks it finds; these 
tracks are passed to a fifth FPGA for additional processing which includes 
sorting, matching tracks and CPS clusters, counting tracks, and calculating 
sector occupancy and total pr- Tracks from each sector are sent over gigabit 
coaxial cables to LlMuon, where the tracks are matched to hits in the muon 
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(enlarged view above) 



Fig. 58. Transverse schematic view of a single 4.5° sector. A hypothetical track 
is overlaid on the eight CFT axial doublet layers and CPS axial layer. The track 
equations require a fiber hit on all eight CFT axial layers. Note that the CPS is 
relatively farther from the CFT than shown. 

Table 7 

Track equation distribution in each track-finder FPGA 





Pt range 




FPGA Resources 


Pt bin 


(GeV/c) 


Track equations 


(system gates) 


Maximum 


> 10 


3000 


200k 


High 


5-10 


3000 


200k 


Medium 


3-5 


4000 


300k 


Low 


1.5 - 3 


10000 


500k 



detector. Counts of tracks and occupancy data are passed downstream to 
the octant boards over LVDS links. 

The next tier of DFE boards (CTOC) collects and sorts data within an 
octant (ten sectors). The CTOC boards receive track counts and sector 
occupancy data from the DFEAs and then sum up the number of tracks, 
determine which sector had the most fibers hit, and check for isolated tracks. 
This information is passed on to a single DFE board (CTTT) where the 
individual trigger term bits are generated and sent to the trigger framework 
within 2.5 iis of the beam crossing. The CTTT can provide up to 96 trigger 
terms of which 55 are currently defined. Two examples of CTTT trigger 
terms are i) at least one track above a pt threshold of 1.5, 3, 5, or 10 GeV/c 
and m) at least one isolated track above 5 or 10 GeV/c and at least one 
track with a confirmation in the CPS for triggering on electrons. 

The TFW issues an LI Accept control bit by considering trigger term 
bits from many different subsystems and makes a global LI decision. Upon 
receiving an LlAccept, the AFE boards digitize the fiber data from the 
appropriate analog buffers in the analog pipeline with 8-bit resolution. When 
the LlAccept control bit embedded in the data stream reaches the DFEA 
boards, they send a sorted list of tracks and CPS clusters to the CTOC 
boards. At this processing stage, finer pt information is available than that 
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Fig. 59. CPS stereo subsystem hardware. 
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Fig. 60. FPS subsystem hardware. 

used at LI. The lists are sorted by the CTOC and CTQD boards and passed 
downstream to preprocessor crates for more detailed analysis. These track 
lists, remapped onto the geometry of the silicon tracker, are also used as 
seeds for the L2STT. Additionally the CTOC and CTTT boards send copies 
of their input data to the L3 readout system for monitoring and debugging. 
CPS stereo 

The CPS stereo subsystem (Figure 59) provides information on the clusters 
in the two stereo layers of the CPS. Unlike the other LICTT subsystems, 
CPS stereo does not generate LI trigger terms. Rather, the DFE stereo 
(DFES) boards store discriminator bits and begin processing only after an 
LI trigger decision has been made. 

Event buffers in the DFES FPGAs store discriminator bits sent from the 
AFE boards. Upon receipt of the LI Accept control bit, the DFES boards 
extract the discriminator bits and search for clusters of hits in the stereo 
layers. Sorted lists of CPS clusters are sent on to the L2PS preprocessor 
for additional analysis. The DFES boards also send a copy of either their 
inputs (the discriminator bits) or their L2 outputs (the hit clusters) to the 
L3 readout system. 
FPS 

The FPS subsystem (Figure 60) produces its own set of LI trigger terms, 
which are passed to the TFW. The overall structure of the FPS subsystem 
is similar to the CFT/CPS axial subsystem in that the FPS has three tiers 
of DFE boards: a finder (DFEF), a concentrator (FPSS), and a trigger term 
generator (FPTT). 

The DFEF boards receive discriminator bits from the AFE boards and 
search for clusters of hits in the FPS fiber layers. A list of clusters is stored 
in the DFEF for later L2 readout while counts of clusters are passed down- 
stream to the FPSS boards. The FPSS boards sum these cluster counts 
and pass this information to the FPTT, where the LI trigger terms are 
produced. 
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When the TFW issues an LlAccept, the FPS subsystem switches into 
readout mode. The AFE boards begin digitizing and reading out fiber data, 
while the DFEF boards extract cluster lists from their buffers. These lists 
of clusters are concatenated and sorted by the FPSS boards before being 
sent to the L2PS preprocessor. The FPSS and FPTT boards send their LI 
input data to the L3 readout system. 
• STT 

The STT subsystem, described in detail in Section 9.2.2.5, is used to map 
the DFEA outputs onto the sixfold STT/SMT geometry. After an LlAccept 
has been issued, hsts of LICTT seed tracks generated by the DFEAs are 
concatenated and reformatted for the L2STT by an LICTT subsystem con- 
sisting of two types of boards: six STOV ("overlay" or "overlap") and six 
STSX ("sextant") boards (Figure 57). Two types of board are necessary 
because the maximum number of input/output links on each board does 
not allow the remapping to be done in one set of boards. The DFEAs have 
duplicate outputs: one set feeds the CTOCs, the other the STOVs (DFEA 
outputs shared between L2STT sextants) and STSXs (outputs unique to a 
sextant). The STOV outputs are fed into the STSXs; the STSXs send the 
data (hsts of LICTT tracks) via six optical fibers to the L2STT system. 



9.1.4 Level 1 muon trigger 

LlMuon looks for patterns consistent with muons using hits from muon wire 
chambers, muon scintillation counters, and tracks from the LICTT. Field 
programmable gate arrays are used to perform combinatorial logic on roughly 
60,000 muon channels and up to 480 tracks from LICTT for every bunch 
crossing. Data from the detector front-ends are transmitted on custom Gbit/s 
serial links over coaxial cable. The serial link receivers and FPGAs are located 
on VME cards that reside in four custom VME crates on the detector platform. 

The muon system (and LlMuon) is divided into central, north, and south re- 
gions. Each region is further divided into octants. Front-end data from each 
octant are processed by two LlMuon trigger cards (Figure 61). The scin- 
tillator trigger cards (MTC05) match central tracks to muon scintillator hits 
while the wire trigger cards (MTCIO) match scintillator-confirmed track stubs 
in wire chambers between the two or three layers of the muon system. The 
octant decisions from each MTC05/MTC10 pair in a region are summed in 
the muon trigger crate managers (MTCMs) and sent to the muon trigger man- 
ager (MTM). The MTM forms 256 global LlMuon triggers and sends up to 
32 of these to the TFW. The download of the specific triggers is handled via 
EPICS software (Section 11). The total latency of the LlMuon trigger is about 
3.20 jis, driven by the central wire chambers (PDTs) and tracks from LICTT. 
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Fig. 61. Level 1 muon trigger system overview. Each octant has two trigger cards 
that process muon detector hit information and LICTT tracks for that octant. The 
octant triggers for a given region are summed on the MTCM and sent to the MTM, 
which combines the three regions and sends up to 32 triggers to the TFW. 



9.1.4.1 LlMuon hardware All detector inputs to LlMuon use Gbit/s 
serial links. The transmitters and receivers are 1.5" x 2.2" daughter cards that 

are mounted on the muon front-end boards and on the LlMuon trigger cards. 
Each serial link can transmit up to 16 x 7 = 112 bits every 132 ns crossing. 
All MTC05, MTCIO, and MTM trigger cards use a common motherboard 
with sixteen serial links and different flavor daughter cards that perform the 
MTC05, MTCIO, and MTM logic. 

The MTC05 cards match tracks from LICTT to hits in the muon scintillator 
system. Each octant trigger card receives tracks from the LICTT for the ten 
4.5° sectors in that octant plus one sector of overlap on either side. Each sector 
sends the six highest-p-r tracks to LlMuon, and each track contains the CFT 
fiber position in the outer layer, value, and sign of the track curvature in 
the central magnetic field. The triggers formed by the MTC05 cards include 
loose (track matched to A-layer scintillator) and tight (track matched to a 
scintillator road using the A and B layers) for four pt thresholds (roughly 1.5, 
3, 5, and 10 GeV/c). Loose and tight scintillator-only triggers are also formed. 

The MTCIO cards form triggers based on wire hits. In the central region, the 
hits from the wire chambers (PDTs) are sent directly to the trigger cards. The 
hits for each layer are used to form track stubs, or centroids, which are then 
used to confirm scintillator hits in each layer. Triggers are formed by matching 
centroid- confirmed scintillator hits between layers. In the forward region, the 
centroid finding is done by separate centroid-finding cards (MCENs), which 
subsequently send the centroids to the MTCIO cards. The MTCIO cards then 
use the centroid-confirmed scintillator hits to form loose (A-layer) and tight 
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Fig. 62. A schematic view of the LIFPD trigger. The dashed boxes indicate Run I 
surplus boards; the bold boxes indicate Run II standard; and the thin boxes indicate 
custom FPD electronics. CuSL is a copper serial link. 

(A- and B-layer) triggers. 

The data from the various front-end systems arrive asynchronously at LlMuon 
and must be synchronized before triggers can be formed for a given event. To 
accomplish this, all received data are written directly into FIFOs which are 
initially empty. When all FIFOs are not empty (i.e., they have all received 
data for the first bunch crossing), the data are read from the FIFOs and sent 
to the MTC05, MTCIO, or MTM cards for trigger formation. In addition to 
synchronizing the data for a given event, the trigger cards also buffer the 
input data and trigger decisions pending global LI and L2 trigger decisions. 
The input data and trigger decisions are stored in dual port memories and a 
pointer to the data is written into a FIFO. When an LI or L2 accept is received, 
the pointer is used to read the data for a particular event. The LlMuon trigger 
can also send all of the received input data from the detector front-ends to aid 
debugging. 



9.1.5 Level 1 forward proton detector trigger 

LIFPD selects events in which the outgoing beam particles pass through one 
or a combination of the nine FPD spectrometers (Section 7). A schematic view 
of the LIFPD design is shown in Figure 62. 

The signals produced in the FPD scintillating fibers are read out via 16- 
channel MAPMTs, and are then amplified and shaped before being passed 
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to the AFE boards. In addition to providing analog fiber charge integration 
information to the L3 data acquisition system, the AFE boards pass discrimi- 
nated signals via LVDS connections to three DFE boards every 132 ns. At the 
DFE boards, pixel hit pattern recognition (a pixel is defined to be a u, x, and 
V fiber crossing) is used to compare the fiber hit information with detector 
hit patterns stored in FPGAs. Three FPGAs containing between 600,000 and 
1.5 million gates store generated LI hit patterns for the nine spectrometers. 
The DFE boards also send their processed data to the L3 trigger system. The 
relative positions of the fibers in the different planes of each detector are used 
to define a finely segmented grid in which to search for hit patterns with opti- 
mal spatial resolution. Hit trigger conditions are set with different thresholds 
corresponding to different numbers of fiber layer hit coincidences. 

The FPD trigger manager (TM) searches for coincidences between the discrim- 
inated hit signals of both position detectors of any FPD spectrometer. We use 
a set of nine FPD spectrometer (single diffractive) triggers with differing hit 
thresholds to select events in which at least one of the outgoing beam particles 
leaves the interaction region intact. Coincidences between the spectrometers 
on different sides of the interaction region are required to trigger on events 
in which both outgoing beam particles leave the interaction region intact in 
back-to-back configurations (elastic diffractive triggers) and in the larger set of 
other two-spectrometer configurations (double pomeron triggers). To reduce 
the contribution from beam halo spray particles that mimic a trigger signal, 
events with large hit multiplicities are rejected. The FPD information can be 
combined with timing information from the FPD trigger scintillator photo- 
multipher tubes (FPD LM), veto counters, and the luminosity monitor (D0 
LM) . The decision is then passed to the TFW. 



9.2 The Level 2 trigger 



The L2 trigger provides detector-specific preprocessing engines and a global 
stage (L2Global) to test for correlations in physics signatures across detec- 
tor subsystems. The L2 trigger system was designed to handle input rates of 
up to 10 kHz with a maximum accept rate of 1 kHz. L2 preprocessors col- 
lect data from the front-ends and LI trigger system and analyze these data 
to form physics objects. L2 can also combine data across detectors to form 
higher quality physics objects and examine event-wide correlations in all L2 
physics objects. The L2Global processor selects events based on the set of 
128 selections applied at LI and additional script-controlled criteria. Events 
passing L2 are tagged for full readout and further analysis in the L3 trigger. 
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Fig. 63. L2 data paths and connections. Data paths are labeled according to trans- 
mission protocol, either 1.3 Gb/s fiber G-Links, 160 Mb/s copper Cypress Hotlinks, 
or 1.4 Gb/s copper AMCC links. FIG indicates a fiber converter card, MBT an 
Mbus transceiver card, and /3 an L2/3eta card. The number of transmission cables 
is given for each pathway. 

9.2.1 Architecture and components of the L2 trigger 

L2 includes preprocessors for each detector subsystem and a global proces- 
sor for integration of the data. Preprocessor subsystems include tracking, 
calorimeter, preshower, and muon systems. The subsystems work in paral- 
lel and trigger decisions are made in the L2Global stage based on physics 
objects reconstructed in the preprocessors. Preprocessing is performed either 
with serial CPU-based cards or with CPU cards plus highly parallelized DSP 
or programmable logic-based cards. The preprocessor and global stages func- 
tion as 2- or 3-stage stochastic pipelines as illustrated in Figure 63. 

Data arrive at the L2 system via three transmission protocols. Calorimeter 
and tracker data and signals from the TFW are transmitted by 1.3 Gbit/s 
serial G-Links [111] on optical fibers. The muon system uses 160 Mbit/s Cy- 
press Hotlink [112] transmitters on coaxial cables or standard CAT/6 cables, 
unshielded twisted pair (UTP) Hotlinks. 
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Fig. 64. Typical layout of cards in an L2 preprocessor crate. Cards that could be 
installed in parallel to increase input channels or processing power are designated 
by stacked boxes. 

9.2.1.1 L2 crates The L2 system occupies 9U VME crates built to the 
VME64/VIPA [69] standard. In addition to a 64-bit VME bus, these crates are 
instrumented with a custom high-bandwidth 128-bit bus (Magic Bus [113] or 
Mbus) for fast intra-cratc data flow and communication. The Mbus supports 
data rates of up to 320 Mbit/s. The VME backplane is used to read out events 
accepted by L2 into L3 and for control and monitoring operations. 

A typical L2 preprocessor/global crate contains the following devices: 

• VME controller and dual-port-memory (DPM) card used for downloading 

runtime parameters and for reporting monitoring data to the TCC 

• a VME single-board computer (SBC) used to send data to L3 

• one or more Mbus transceiver (MBT) cards (Hotlink-to-Mbus interface, 
Section 9.2.1.2) 

• one or more sets of fiber converter (FIC) and VME transition (VTM) cards 
(fiber-to-hotlink interface. Section 9.2.1.2) 

• one or more L2/9eta processor cards (VME and Mbus hosted SBCs, Sec- 
tion 9.2.1.3) for data processing. 

The layout of the preprocessor/global crates is shown in Figure 64. L2STT 
(Section 9.2.2.5) and L2Muon (Section 9.2.2.2) use additional specialized cards 
for processing their data before sending track information to the L2CTT and 
L2Muon preprocessors respectively. 



9.2.1.2 Magic bus transceiver and data conversion cards Data ar- 
riving at L2 must first be converted into the correct physical format before 
processing can begin. The coaxial Hotlink data from the muon system is re- 
ceived by analog cable input converter (CIC) cards. These cards retransmit 
the data to the first stage of L2Muon as differential UTP Hotlink signals. A 
relative of the CIC card, the serial fanout (SFO), selectively fans out 1 to 
12 UTP Hothnks where signal duplication is necessary. Similarly, FIC cards 
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receive G-Link data and buffer up to sixteen events while converting the in- 
puts to differential UTP Hotlink signals. The incoming fibers are received by 
a VME transition module (VTM) located at the rear of the crate. 

Data are passed to L2/5eta processors via the Mbus. An MBT card transfers 
data to and from the Mbus. The MBT accepts up to seven Hotlink inputs, 
assembles the data into events, and broadcasts them on the Mbus backplane 
to the L2/3eta cards. The high speed, 128-bit input path is equipped with a 
buffer for up to sixteen events. There are two Hotlink output paths that are 
targets of the 128-bit Mbus programmed I/O on the L2/9eta cards. These are 
used by preprocessors to send their output to L2Global. 

One MBT, designated the "pilot," coordinates the event broadcast across all 
MBTs and receives SCL information for the crate from the TFW, including the 
LlAccept information, L2 decision information, and SCL initialize messages. 
The pilot MBT in the L2 global crate transmits the L2 decision to the TFW 
over sixteen PECL output channels. A demultiplexing card receives eight 16- 
bit words and transmits the 128-bit decision to the TFW. 



9.2.1.3 L2/3eta processors L2/3eta processor cards are used for analy- 
sis and control of data flow in each preprocessor subsystem crate. The L2/9eta 
processors replaced the original L2 Alpha boards ^ early in Run II and are com- 
posed of commercially produced (Compact PCI standard [116]) SBCs mounted 
on 6U-to-9U VME adapter cards. Each SBC provides dual 1 GHz Pentium 
processors. The SBC connects to the adapter via a 64-bit, 33/66 MHz PCI 
bridge. The 9U adapter, controlled by the SBC, implements all D0-specific 
protocols for Mbus and TFW connections. Custom I/O functions on this card 
are implemented in a single FPGA (Xihnx XCV405E) plus assorted logic con- 
verters and drivers. The FPGA is used to implement internal data FIFOs and 
address translation tables for broadcasting data from the Mbus to CPU mem- 
ory, reducing the complexity of the adapter card. Mbus programmed I/O and 
various other trigger system interfaces, via front panel connections and VME 
user-defined pins, are also implemented. The adapter also provides a 64-bit 
PCI-to-VME interface via a Tundra Universe II chip [117]. 

The L2/5etas run a GNU/Linux system and all programs are written in C++. 
Real time trigger performance is achieved by restricting system calls (includ- 
ing dynamic memory allocation) and promoting the L2 executable to a non- 

^ L2Alpha processors were similar to those constructed by the CDF experi- 
ment [114,115]. They were based on the PC164 motherboard manufactured by Dig- 
ital Semiconductor (now Compaq). Each card contained a 500 MHz 21164 64-bit 
Digital Alpha CPU and 21164 PCI interface integrated with the necessary hard- 
ware interfaces. The L2Alphas have been supplanted by the higher performance 
and upgradable L2/?eta cards. 
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interruptible scheduling queue. The second CPU provides full access to the 
SBC for runtime monitoring and control. 

9.2.2 L2 preprocessor subsystems 

9.2.2.1 L2Cal The calorimeter preprocessor system identifies jets and elec- 
trons/photons and calculates event J^j^ for the global processor. The worker 
code may be combined to run serially in a single processor or placed in separate 
processor cards to increase throughput as data rates and detector occupan- 
cies grow with luminosity. Each processor uses the Et data from the 2560 
calorimeter trigger towers. The input data arrives on ten input links which to- 
gether transport 3 kB/event of tower transverse energy data, including both 
EM towers and the EM-I-H tower sums. 

The jet algorithm operates by clustering n x n (currently n = 5) groups of 
calorimeter trigger towers which are centered on seed towers. The seed towers 
are E'y-ordered with Et > 2 GeV. Overlapping candidates may be reported 
as separate jets depending on programmable criteria based on the number of 
shared towers (otherwise the highest-E'T jet of the overlapping candidates is 
kept). The list of jets is passed to L2Global which applies jet requirements as 
defined by the trigger menu. 

The electron/photon algorithm begins by defining an iJy-ordered list of EM 
towers with Et above 1 GeV. For each seed tower, the neighboring tower 
with the largest Et is combined with the seed to make an EM cluster. The 
EM energy fraction of the leading- and sub-leading- trigger towers of the 
cluster and the amount of total Et in a 3 x 3 tower array surrounding the seed 
tower of the cluster are used to reduce background. The final list of electron 
candidates is sent to L2Global to apply the trigger requirements. 

The L2 calorimeter algorithm calculates the vector sum Et from the indi- 
vidual trigger tower total-ET energies passed from LI. It is capable of calcu- 
lating the for different minimum tower EtS and rj ranges. 

9.2.2.2 L2Muon L2Muon uses calibration and more precise timing infor- 
mation to improve the quality of the muon candidates [118]. It receives the 
LlMuon output and data from approximately 150 front-end modules (from the 
PDTs, MDTs, and the scintillation counters). The muon candidates contain 
the track pt, rj and 4> coordinates, and quality and timing information. 

L2Muon implements one extra level of preprocessing in the stochastic pipeline 
sequence. The first L2Muon stage incorporates eighty 200-MIIz DSPs in a 
parallel processing scheme. Each DSP is responsible for finding track segments 
in a small region of the detector, so that the total execution time of the 
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Fig. 65. Layout of cards in an L2Muon crate. Two stages of processing are completed 
in a single crate using SLICs and L2/3eta processors. Central and forward muon 
regions are processed in separate crates of similar configuration. 

algorithms is independent of the number of hits. The DSPs are geographically 
organized in eleven central and five forward 9U VME boards (second level 
input computers or SLICs) , with each SLIC containing one administrator and 
four worker DSP chips. The SLICs are programmable in C. The layout of an 
L2Muon crate is shown in Figure 65. The DSP algorithms, characterized by 
the detector region (central or forward) and the input or sub-detector plane 
(LI, A or BC muon layers), make use of detector symmetry to run the same 
basic processing code. The MBT sends the stubs found by the SLICs to the 
L2/9eta processor. The L2/9eta board uses the track segments to construct 
integrated muon candidates with an associated pt and quality. 



9.2.2.3 L2PS Both the central and the forward preshower detectors are 
designed to provide high electron detection efficiency, electron-photon separa- 
tion and high background (charged hadron) rejection at the trigger level. This 
is accomplished by providing evidence for early shower development and by 
giving a good spatial point for comparison with calorimeter clusters or tracks. 
At L2, the CPS and FPS are treated as separate detectors and their data are 
processed independently. 

Upon LlAcccpt, CPS axial clusters from each of the eighty azimuthal trigger 
sectors are combined into quadrants in azimuth and transmitted to the L2 pre- 
processor. Stereo clusters are sent directly to the L2 preshower preprocessor. 
Figure 63 shows the LI to L2 data transfer path into the preshower subsystem. 
The L2CPS preprocessor receives axial {x) clusters over four G-Links, each 
serving one azimuthal quadrant. The CPS stereo data arc transmitted over 
four G-Links, two for each hemisphere (positive/negative tj), including both 
u and V layer clusters. Axial clusters are tagged by LI with the presence or 
absence of a CFT track. Each of the G-Links can carry a maximum of 48 axial 
CPS clusters or 96 stereo clusters. 

In the L2/5eta processor, the CPS cluster centroids are compared to produce 
T) and (f) coordinates for clusters that match in three layers. The presence or 
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absence of CFT trigger tracks associated with CPS x clusters is also provided, 
and output clusters are flagged as electrons (when there is a track associated 
with the cluster) or photons (no track). The r] and coordinates are binned 
to correspond to the calorimeter trigger tower geometry of x = 0.2 x 0.2. 
A window of width 0.05 is drawn around each calorimeter trigger tower, and 
any preshower hit in this r^, region is designated a calorimeter match. The 
FPS provides similar functionality and is the only source of forward tracking 
information available before the L3 trigger. 



9.2.2.4 L2CTT The L2CTT preprocessor takes inputs from the LICTT 

and the L2STT. This preprocessor system has been designed to operate in two 
different modes: i) with input tracks straight from LICTT and ii) with input 
tracks from L2STT which receives input from the LICTT and SMT barrels. 

In the first mode of operation, L2CTT reads in the track lists from different 

regions of the LI tracking trigger system and concatenates these into a single 
PT-sorted list. The measurements are reflned using additional hit and track- 
ing information than is available at LI. For each track, the azimuthal angle 
with respect to the beamline, 0o, is determined. The value of the azimuthal 
angle at the third layer of the EM calorimeter, (pemZi is also calculated (0em3 
is different from 0o due to the bending of tracks in the solenoidal magnetic 
field). Finally, each track is evaluated according to several isolation criteria 
to enhance the trigger capabilities for tau leptons. The pr-sorted list of L2 
tracks is reported to L2Global. In the second mode of operation, input data 
are provided by the L2STT along with refined L2 track p^S- Only 0em3, 
and isolation are calculated for these data. However two separate lists of L2 
tracks are passed on to L2Global, one sorted according to Pt and another 
sorted according to impact parameter. 



9.2.2.5 L2STT The L2STT performs onhne pattern recognition in the 

data from the SMT. It reconstructs charged particle tracks found in the CFT 
at LI with increased precision by utilizing the much finer spatial resolution of 
the SMT. 

The L2STT improves the momentum measurement of charged particle tracks 
at the trigger level. Requiring hits in the SMT helps reject spurious LI triggers 
from accidental track patterns in the CFT. The primary physics justification 
of the L2STT is its abihty to measure the impact parameter of tracks precisely 
enough to tag the decays of long-hved particles, specifically B hadrons. 

Figure 66 shows the basic principle of the L2STT. For each event, the LICTT 
sends a list of tracks to the L2STT. A road is defined around each track, and 
the SMT hits within the road are associated with the track. The L2STT uses 
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Fig. 66. The definition of roads based on LI tracks and SMT hit selection in L2STT. 

only the hits in the axial strips of the silicon ladders, which define points in 
the r — (f) plane. The L2STT uses the hits in the innermost and outermost 
layers of the CFT and hits in at least three of the four layers of the SMT to 
fit the track parameters. The results of the fits are sent to L2Global. 

The SMT barrel ladders are arranged in twelve sectors, each covering 30° in 
azimuth. The ladders of adjacent sectors overlap slightly such that more than 
98% of all tracks are contained in a single sector. The L2STT therefore treats 
all 30° sectors independently. 

The L2STT consists mainly of custom-designed digital electronics modules. 
All custom modules are designed to plug into a motherboard, and a common 

motherboard design is used throughout the system. Data input from the SMT 
detector and the LICTT is via optical fiber serial links into receiver cards 
(VTMs) located in the rear card cage of the VME64/VIPA crates that house 
the L2STT electronics. The data are processed in large FPGAs and/or DSPs 
on a logic daughterboard that sits on the motherboard. There are three dif- 
ferent types of such daughterboards in the system. Data are communicated 
between modules in an L2STT crate using a serial link transmitter and re- 
ceiver cards. Each module is equipped with a daughterboard that buffers data 
for readout through the data acquisition system once an event has been ac- 
cepted by the trigger system. The logic daughterboard is connected to the 
buffer cards, the serial links, and to the VME backplane by three PCI buses 
on the motherboard. The VME bus is used for initialization and monitoring 
and to read data out of the buffer cards. 

The three types of logic daughterboards are the fiber road card (PRC), silicon 
trigger card (STC), and track fit card (TFC). The PRC receives data from the 
LICTT and the TFW that it fans out to the other modules. The PRC also 
manages the storage of data in the buffer cards. The STC receives the SMT 
data, clusters hits in adjacent strips, and associates SMT clusters with roads. 
The TPC performs the final hit selection and fits the tracks. 

L2STT consists of six identical VIPA crates, each serving two 30° sectors. 
Each crate is equipped with one PRC module, nine STC modules, and two 
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Fig. 67. Data flow through an L2STT crate. 

TFC modules. Each crate also has a CPU board to program the FPGAs and 
DSPs, download constants, and monitor system performance. An SBC is used 
to read data out of the buffer cards and feed them into the data acquisition 
system. 



Figure 67 shows the flow of data through an L2STT crate. Each of the twelve 
TFCs provides a hst of tracks from its 30° sector. The track information 
includes track parameters and the of the fit as well as additional information 
about the cluster selection and fit. One TFC in each of the six crates also 
transmits a list of the initial LICTT tracks. These data arc transmitted to 
the L2CTT, where the tracks are sorted by px and impact parameter and 
passed to L2Global to be used in the trigger decision. The data are also sent 
to a buffer card for readout to L3. 



The L2STT helps to select events with an enhanced heavy-flavor content 
by measuring the impact parameter h of reconstructed tracks with respect 
to the beam. Figure 68 shows the impact parameter resolution cTfe obtained 
from simulated single muon events. The impact parameter resolution has 
a Pt dependence introduced by multiple scattering. In the trigger, the ef- 
fect of this Pt dependence can be reduced by using the impact parameter 
signiflcance Si, = h/ui, instead of the impact parameter h. The uncertainty 
(76 = ^(18//m)2+ [(50//mGeV/c)/pr]^ (for tracks with four SMT clusters in 
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Fig. 68. Impact parameter resolution as a function of pT determined using simulated 
single muon events. 

the fit) takes into account the effect of multiple scattering. 
9.2.3 L2Glohal 

L2Global is the first level of the trigger to examine correlations across all detec- 
tor systems. The L2Global worker is responsible for making trigger decisions 
based on the objects identified by the L2 preprocessors. Trigger decisions are 
made by creating global physics objects. These objects can be based directly 
on the objects reported by the preprocessors or can be created by combining 
objects from different preprocessors. The L2Global worker imposes require- 
ments on the global physics objects according to configuration information it 
receives from the TCC based on the downloaded trigger menu. 



9.2.3.1 Inputs to L2Global After an LI Accept is issued, the TFW sends 
a trigger decision mask to L2Global. The SCL sends notification of an LI 
accepted event to every geographic sector. In the case of L2 preprocessors, 
the receipt of the LlAccept SCL message means that the preprocessor must 
send at least a header block to L2Global for this event, and must prepare 
at least a header block for eventual L3 readout in case the event passes L2. 
When L2Global receives the LlAccept, L2Global performs a decision cycle 
and prepares at least a header block for L3 readout if the event passes (or if 
it is an Unbiased Sample as described below). 

For each event, the L2Global worker uses the LI trigger decision mask and 
preprocessor inputs to decide which algorithms to run on the data from the 
preprocessors. It then makes a trigger decision and returns this decision to the 
TFW. The trigger list specifies which trigger conditions L2 will impose for each 
run. The trigger list can change as frequently as every run. The trigger list is 
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downloaded to the L2Global crate by the TCC, which receives its instructions 
from COOR. 

A number of LI quahfier bits may be sent along with a given LlAccept. Of 

these LI qualifiers, the ones of special interest to L2Global are "Unbiased Sam- 
ple" (UBS), "Forced Write", and "Collect Status." For a UBS event, L2Global 
sends the event to L3 whether or not any of the L2 bits actually passed, mark- 
ing the condition in the L2Global event header. The actual L2 decision is also 
recorded. Such events occur at a rate determined by the trigger programming, 
for an independently adjustable fraction of events passing each LI bit. A sec- 
ondary effect of the UBS qualifier in L2Global is that additional information is 
written to L3 to assist in debugging the event. In particular, the output from 
L2Global is expanded to include more information to allow detailed checking 
of the processing. Events marked with the UBS qualifier are routed to a special 
data stream for system monitoring. 

The Forced Write qualifier provides a mechanism to test new trigger defi- 
nitions. Unlike the UBS qualifier, Forced Write produces detailed output at 
every firing of an LI trigger bit that is marked with this qualifier. The Forced 
Write qualifier has the same effect on L2 as the UBS qualifier, however Forced 
Write events are routed to the standard output stream for offline analysis. 

After receipt of an event with a Collect Status qualifier, L2Global (and all 
preprocessors) capture internal scaler and other monitoring information (in- 
cluding distributions of processing times and pipeline occupancies) for readout 
by the TCC. The monitoring blocks are tagged with the LI crossing number 
of the event with the Collect Status qualifier, so the TCC can assemble a con- 
sistent set of statistics in the LI and L2 systems. Collect Status quahfiers are 
generated approximately once every five seconds in a typical data run. 



9.2.3.2 Trigger scripts The L2Global worker begins the processing of 
every event by checking which of the LI trigger bits fired. The trigger list 
specifies which L2 script is associated with each LI bit. The L2 script is the 
trigger condition that must be satisfied in order for the L2 trigger to fire for a 
given LI bit. The L2 script is specified by a number of filters and a minimum 
number of objects required to pass each filter. An example of a script is an 
electromagnetic object filter and a minimum of two objects. This script is 
satisfied if there are two electromagnetic objects in the event that satisfied 
the conditions of the filter. If any script is satisfied, the event passes L2 and 
is sent to L3. 



9.2.3.3 Tools and filters Tools and filters provide the main functions 
of the L2Global worker. The filters make up the scripts described above and 
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in turn rely on tools. Tools arc C++ classes that build a specific type of 
L2Global object. L2GIobal objects are based on preprocessor objects. A tool 
starts with a list of preprocessor objects and applies selection criteria to decide 
which preprocessor objects should be made into global objects. A tool can also 
correlate information from two preprocessors by combining two preprocessor 
objects to form one global object. An example of this is the combination of 
a track object and an EM object that come from different preprocessors, but 
refer to the same electron candidate. The tools are written to be flexible and 
are configurable through the trigger list. For the above example, one trigger list 
parameter specifies whether or not EM objects from the preprocessor should 
be matched to tracks from the tracking system. 

The tools produce lists of global objects. The filters then use these lists of 
global objects to make a trigger decision by imposing trigger requirements 
on the objects. For the case of an EM object, the electromagnetic fraction, 
transverse momentum, and isolation can be required to have values above or 
below specified thresholds to satisfy the filter. The filter generates its own list 
of objects that satisfy the trigger criteria. Tools and filters can also operate 
on global objects from earlier filters to construct additional global objects of 
greater complexity. At the conclusion of processing, the script checks to see 
if there are at least the minimum number of objects required to satisfy the 
script requirements. 



9.3 The Level 3 trigger 



The L3 trigger provides additional rejection both to enrich the physics sam- 
ples and to maintain an acceptable throughput which can be recorded to tape. 
A high level, fully programmable software trigger, L3 performs a limited re- 
construction of events, reducing a nominal 1 kHz input rate to 50 Hz for 
data recorded for offline analysis. Its decisions are based on complete physics 
objects as well as on the relationships between such objects (such as the ra- 
pidity or azimuthal angle separating physics objects or their invariant mass). 
Candidate physics objects, or relations between them, are generated by object- 
specific software algorithms (filter tools). Tools perform the bulk of the work: 
unpacking raw data, locating hits, forming clusters, applying calibration, and 
reconstructing electrons, muons, taus, jets, vertices, and If^j.. Reference sets 
(refsets) of programmable algorithm parameters are input to the tools via the 
programmable trigger list. The refsets define the physics objects precisely (jet 
refsets specify cone size, for example, and electron refsets, the electromagnetic 
fraction, among other characteristics) for each invocation of the filter tool. All 
tools cache their results to expedite possible multiple calls within the same 
event, and if the event is accepted, add L3 object parameters to the data 
block. 
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Individual calls to the tools are made by filters that define the specific selection 
criteria employed by a tool or imposed on its results. These criteria include the 
refset used by the tool, as well as thresholds and other cuts applied by the filter 
on the results of a tool (for example, the requirement of two jets within a given 
pseudorapidity range above a fixed Et threshold) . Filter results are keyed for 
access by other filters, so in addition a key to the results of a previous filter 
can be included in these parameter sets. Part of the trigger programming, this 
information can be changed with each trigger list download. 

The trigger list programming includes blocks of filter scripts that specify one 
or more filters and that define the L3 trigger condition for each L3 trigger 
or filter bit. Each L3 filter script is associated with a L2 bit; multiple L3 
scripts may be associated with each L2 bit. Failure to pass an individual filter 
terminates execution of the script, calling no further tools, and skipping to 
the script for the next filter bit. Only when all filters in a script are satisfied, 
is the trigger satisfied and the event sent to the host cluster to be recorded. 

9.3.1 ScriptRunner 

Each filter tool receives event data under the direction of ScriptRunner, the 
interface of the L3 framework to the tools. At the beginning of a run, Script- 
Runner initiates parsing of the tool refsets and the filter scripts. L3-relevant 
pieces of the trigger list (and event data) are its input. Needed tools initialize 
themselves with the necessary calibration constants and refsets. ScriptRunner 
then processes any errors and parses the scripts to build the execution tree. 
The output of ScriptRunner is filtered event data dispatched to the data log- 
ger, monitoring information (individual and combined filter rates and timing 
of both filter scripts and individual tools collected in the event loop) , and error 
messages. At the end of a run (and upon request) ScriptRunner extracts and 
reports monitor information and rates. 

In the order specified by the trigger list, the execution path proceeds along 
the branches of each L2 trigger bit that has been set. Each filter branch is 
traversed, with tools called in the given filter script order until an event fails 
a filter or passes all filters; execution then returns to the filter bit level and 
proceeds to a sister filter bit branch, if one exists, or continues to the next 
trigger bit. Control is returned to ScriptRunner as soon as an event fails a 
filter or after it passes all filters. 

9.3.2 Available physics object tools 

9.3.2.1 Level 3 jets and electrons The L3 jet tool relies on the high- 
precision calorimeter readout and primary vertex position available at L3 and 
the improved energy and position resolution this information makes possible. 
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Fig. 69. The L3 jet trigger turn-on. Effieieney is plotted as a funetion of offline 
leading jet pT- A selection cut of 15 GeV/c has been applied by the L3 filter. 
Statistical errors are included, although small enough to be obscured by the symbol 
in most instances. 

Implementing a simple cone algorithm and performing a suppression of hot 
calorimeter cells, the L3 jet tool is able to sharpen the turn-on curve dramat- 
ically. Applying offline cleanup cuts on collected data shows sharp turn-ons 
to nearly 100% efflciency for both jet and electron ffltcrs (see Figure 69). 
Rejection factors of 20-50 have been realized for the various jet triggers. 

A simple ^(Ajyj^ + (A0)2 = 0.25 jet cone, with requirements on Et-, elec- 
tromagnetic fraction (> 0.9), and transverse shower shape, forms the basic 
electron tool. An electron candidate match to a preshower detector signal can 
also be required. 
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9.3.2.2 Level 3 muons Wire and scintillator hits are used in the recon- 
struction of muon track segments inside and outside the toroid. Track-finding 
links these segments to identify muon tracks in three dimensions. Refsets de- 
termine the minimum number of hits in each detector layer required for valid 
tracks. In addition to unpacking data and determining tracks in the regions 
defined by L2, the L3 muon tool can call subordinate tools that utilize inner 
tracking and calorimetry. 

L3 improves on the ability of L2 to separate prompt and out-of-time hits by 
fitting the available scintillator hits along a track to the velocity of the par- 
ticle. Remnant cosmic ray muons are recognized by the out-of-time signals in 
addition to their association with a penetrating track opposite their candidate 
track. 

The availability of vertex constraints and the ability to match central tracks 
makes possible improved momentum resolution in L3 compared with L2. A 
track match tool extrapolates muon tracks to the central tracker, defining a 
region to be searched. If more than one central track is available, the track 
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that minimizes the calculated using the angular distances in 9 between 
the central and extrapolated muon tracks is selected. Additionally, matching 
local muon tracks to paths of minimum ionizing particles in the calorimeter 
distinguishes isolated from non-isolated muons. 



9.3.2.3 Missing transverse energy The L3 tool is based on calorime- 
ter cells. Using corrected calorimeter energy (assuming a nominal (x, z) = 
(0, 0, 0) vertex), the J^j^ is calculated through intermediate pseudorapidity ring 
sums (allowing quick recalculation by geometrically corrected ring sums when 
the primary vertex tool returns a vertex position). The tool calculates the 
the azimuthal angle of the total scalar Et, and a significance. 

The filters that make up the L3 trigger are flexible and provide additional 
rejection. For example, adding a J^j. filter to loose electron or muon filters, 
in parallel to single lepton scripts, provides redundancy for triggering on W 
boson events; adding I^j^ to lepton + jets top quark filters provides additional 
rejection factors (a factor of three for electron and eight for muon triggers). 



9.3.2.4 Level 3 tracking CFT track-finding can be performed either in 
specified regions or across the entire detector. At initialization, the calculated 
x,y,(f) fiber positions are stored in lookup tables. Adjacent hits are merged 
into clusters with their a:, position averaged. Tracking is first done using a 
fast circle fit through the axial layers, identifying candidates as arcs through 
the origin and defining an arc length S in the x — y plane. A straight line fit 
in the S — z plane then determines the track helix parameters. 

A link-and-tree algorithm joins clustered hits from different layers. Starting 
from a link in the outer layer (and continuing recursively), candidate tracks are 
built by adding links from adjacent layers, extending the path length as long 
as the curvature is consistent with the preceding link. The longest extended 
path found starting from the initial link is kept as a track candidate. The 
radius defined by the circle through clusters (and the origin) must exceed that 
corresponding to minimum trigger px- 

SMT tracking modifies this method. Segments connect neighboring hits be- 
tween points within a specified A(^. Segment paths are linked when their 
2;-slope and A0 are within (tunable) specifications. Unless seeded by a loca- 
tion set by the candidates from an earlier tool, the algorithm begins with the 
outermost SMT layer, looking for the longest paths toward the center, fitting 
these to a helix. The path with the smallest is selected. 

The CFT-track-based ;s-vertex tool offers substantially higher efficiency and 
purity than an SMT-hit-based algorithm. Its use sharpens the turn-on curve 
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for jet triggers, and provides rejection against events with a primary vertex at 
large \z\. Monte Carlo studies suggest that the tool achieves 0.5 mm 2;-vertex 
position resolution. The CFT-track-based vertex is used for jet identification 
and the calculation. 

A global (SMT plus CFT) high-momentum-track finder starts from axial 
CFT tracks (with matched stereo clusters) propagated into the SMT. If the 
CFT axial/stereo match fails, the CFT-SMT match is done in x^y only. A 
stand-alone global track filter is a useful addition to single muon and elec- 
tron triggers. Starting from axial CFT tracks (with matched stereo clusters) 
propagated into the SMT, the L3 tracker makes an independent selection of 
individual charged high-p^ tracks. This algorithm (with 60 /xm distance-of- 
closest-approach (DCA) resolution for central tracks) runs in less than 200 
ms. Studies of off-line track-matched electrons in a Z — > e+e" data sample 
show a 60% overall efficiency (95% within the CFT-axial acceptance). 

The use of tracking information in the L3 filter refiects a strategy of parallel 
single-electron filters which increase efficiency at low Et and still provide 
redundancy at high Et (for cross checks). These parallel triggers allow high- 
Et fflters with loose cuts (where rejection is not critical) by introducing tighter 
cuts at lower Et- Similarly, L3 global track filters (run on muon triggers) are 
complemented by a suite of L3 muon filters running the stand-alone local 
muon filter for high-pj' single muons. 

Online monitoring keeps track of current beam spot information (the mean 
position and spread in x, y along with tilts va. x,z and Uiz). Using this infor- 
mation, L3 can calculate a fully 3-dimensional primary vertex for each event. 
By recalculating L3 track parameters using the 3-d vertex, L3 is capable of 
triggering on the impact parameter of tracks. The DCA resolution with re- 
spect to the primary vertex is 25 fim.. With input provided by a tracking, jet 
and vertex tool, event, jet and track 6-quark-probabilities based on the signed 
impact parameters of tracks can be calculated, and 6-tagging implemented in 
L3. 



9.3.2.5 Relational filters Additional higher level selections, based on the 
relationship between physics tool candidates, are implemented at the filter 
level. Examples include the invariant mass filter, an acoplanarity tool that 
selects events with the two leading-p^ jet candidates separated by a polar 
angle between (pmin and (pmaxi and an Ht tool that applies a selection cut to 
the scalar sum of the EtS of all jet filter candidates. 
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9.3.3 Special filter tools 

For monitoring purposes, events can be written out regardless of tiic L3 trig- 
ger decision. Special "mark and pass" runs record every L2-accepted event 
and mark them with the results of all filter tools of every script under the 
L1/L2 bit(s) satisfied. Additionally, a "pass one of n" option for each script 
independently specifies a fraction of events to be forced through marked but 
unfiltered. Every event selected in this way passes into a special "monitor" 
stream, distinct from the physics stream. Monitor stream data are collected 
continuously during regular data collection. 

When necessary to prescale events, L3 can mark a filter bit as failed without 
running the filter script. L3Prescale uses selection by random number genera- 
tion (seeded uniquely by node) so that collectively, successive short runs still 
see events in the correct prescale fraction. This implementation by random 
numbers initialized differently in each node is the same means by which "pass 
1 of n" events are generated. 

9.3.4. Online monitoring 

Online monitoring of the L3 system is done in the control room during regular 
data collection. Quick analysis of the event record from randomly sampled 
online events produces distributions of physics quantities (for failed as well as 
passed candidate events). Plots of electron, jet, muon, tau, and global track 
multiplicity, £'t, 0, and r] are continuously reviewed. In addition, a comparator 
package looks for discrepancies between online quantities and those computed 
when the data are run through the trigger simulator offline. 



10 Data acquisition system 

The data acquisition system (L3DAQ) transports detector component data 
from the VME readout crates to the processing nodes of the L3 trigger fil- 
tering farm. The online host receives event data from the L3 farm nodes for 
distribution to logging and monitoring tasks. Overall coordination and control 
of triggering and data acquisition is handled by the COOR program running 
on the online host system. 

10.1 L3DAQ 

The L3DAQ system's designed bandwidth is 250 MB/s, corresponding to an 
average event size of about 200 kB at an L2 trigger accept rate of 1 kHz. 
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Fig. 70. The physical network configuration of the L3DAQ system. The moveable 
counting house holds electronics for the detector and moves with the detector be- 
tween the assembly hall and the collision hall. 
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Fig. 71. Schematic illustration of the information and data flow through the L3DAQ 
system. 

As shown in Figure 70, the system is built around a single Cisco 6509 [119] 
ethernet switch. A schematic diagram of the communication and data flow 
in the system is shown in Figure 71. All nodes in the system are based on 
commodity computers (SBCs) and run the Linux operating system. TCP/IP 
sockets implemented via the ACE [120] C++ network and utility library are 
used for all communication and data transfers. 



Up to sixty-three VME crates are read out for each event, each containing 
1-20 kB of data distributed among VME modules. An SBC (single board 

computer) in each VME crate reads out the VME modules and sends the 
data to one or more farm nodes specified by routing instructions received 
from the routing master (RM) process. An event builder (EVE) process on 
each farm node builds a complete event from the event fragments and makes 
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it available to L3 trigger filter processes. 

The supervisor process provides the interface between the main D0 run control 
program (COOR) and the L3DAQ system. When a new run is configured, the 
supervisor passes run and general trigger information to the RM and passes 
the COOR-provided L3 filter configuration to the EVB process on relevant 
farm nodes, where it is cached and passed on to the L3 filter processes. 

The SBCs are single-board computers with dual 100 Mbit/s Ethernet inter- 
faces and a VME-to-PCI interface. An expansion slot is occupied by a digital- 
I/O (DIO) module, used to coordinate the readout of VME modules over the 
VME user (J3) backplane. A custom kernel driver on the SBC handles inter- 
rupt requests from the DIO module that are triggered by readout requests 
from the crate-specific electronics. On each readout request, the kernel mod- 
ule performs the VME data transfers and stores the event fragment in one of 
several buffers in kernel memory. 

A user-level process on the SBC receives route information from the RM in 
the form of route tags that contain a unique event identifier (L3 transfer 
number) and the indices of the farm nodes to which that event should be 
sent. If the L3 transfer number of the route tag matches that of the transfer 
number embedded within the head event fragment in the kernel buffers, the 
event fragment is sent to the specified farm nodes. 

The EVB process on each farm node collates the event fragments received from 
SBCs into complete events, keyed by L3 transfer number. For each event, the 
EVB receives an expcctcd-cratc list from the RM in order to determine when 
an event is complete. Complete events are placed in shared memory buffers 
for processing by the L3 filtering processes (Section 9.3). The EVB process 
routinely informs the RM of the number of free memory buffers that it has 
available. 

The RM program executes on an SBC in a special VME crate containing a 
hardware interface to the TFW. The TFW provides trigger information and 
the L3 transfer number upon each L2 accept decision and allows the RM 
to asynchronously disable the firing of LI triggers. For each event, the RM 
program chooses a node for processing based on the run configuration, the 
trigger information, and the number of available buffers in the set of nodes 
configured to process the type of event. A node is chosen in a round-robin 
fashion from among the set of nodes with the most free buffers. If the number 
of available free buffers is too few, the RM instructs the TFW to disable 
triggers so that the farm nodes have time to catch up. 
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10.2 COOR and the online host 



Run control and detector configuration are handled by the central coordination 
program COOR. COOR receives requests from users to configure the detector 
or to start and stop runs and sends the necessary commands to the rest of 
the system to carry out those requests. COOR sends commands to LI, L2, 
and L3 and to the manager processes for the SDAQ (see below) and data 
logging subsystems. COOR can also configure EPICS (Section 11) devices 
via a connection to the COMICS (Section 11.3) program. It also maintains a 
database of name/value pairs accessible to the online system for recording the 
current network addresses of various online services and for access by trigger 
configurations; this allows for communicating time-dependent values (such as 
the current beam spot position) to the trigger systems. 

The online host system receives event data from the L3 farm nodes at a com- 
bined rate of approximately 10 MB/s (50 Hz L3 accept rate of 200 kB events) 
and distributes that data to logging and monitoring tasks. The host system 
is capable of supporting multiple simultaneous data runs. Events that pass 
the L3 filters are tagged with a data stream identification that is a function 
of the satisfied hardware and software trigger components. Different streams 
are recorded independently; events are assigned to only one stream, excepting 
some events which are additionally assigned to a special monitoring stream. 

The final repository for the raw event data is tape, maintained in a robotic 
tape system located about 3 km from the detector. Data must be transmitted 
to each tape drive at approximately 10 MB/s to keep the drive operating in 
streaming mode, since the remote tape drive nodes have no intermediate disk 
buffer. The online system is capable of simultaneous output to multiple tape 
streams and of buffering in case of tape robot unavailability. In addition to 
logging data, the online host system must supply between ten and twenty data 
monitoring clients at anywhere from 1% to 100% of the full data rate. 

Figures 72 and 73 illustrate the physical and software architecture of the 
online host system. Event data arrive from the L3 trigger nodes at collector 
processes. The collector directs each event to the data logger appropriate for 
the stream identifier determined for the event. The collector also sends, on 
a best-effort basis (there is no ffow control backpressure to the L3 nodes), a 
copy of each event to a distributor process, which is an event queueing system 
that provides event data in near real-time to online analysis and monitoring 
chents (EXAMINE programs). 

A diagnostic secondary data path, SDAQ, makes possible the processor-based 
readout of digitizing electronics. Information from SDAQ is also routed via the 
collector processes, allowing all downstream DAQ components to be shared. 
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Fig. 72. Schematic of the physical architecture of the onhne host system. We are 
using commodity computers running Linux connected to a Cisco 6509 switch. 




Fig. 73. Schematic of the software architecture of the onhne host system. 

The SDAQ mechanism bypasses the L3DAQ and L3 trigger and is valuable 
in the commissioning and calibration of detector components. The detector- 
specific components of an SDAQ appUcation have access to a library of SDAQ 
functions that handle queuing of data messages between components, interrupt 
management with callbacks, run synchronization, and priority-based schedul- 
ing. Several of the subdetectors use the SDAQ system: the SMT for calibration 
and to monitor the performance of individual silicon detector channels during 
a run, and the CFT, CPS, FPS, and FPD to cahbrate scintillator response. 



The data logger writes data to files, grouped according to stream classifica- 
tion tags. Each data logger is responsible for a set of streams. The data logger 
also generates metadata information in file format for storage in a database 
to enhance the offline access of data. The DLSAM processes are the interfaces 
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to the SAM/ENSTORE mass storage facility (Section 12.6 and the associ- 
ated database descriptions). DLSAM monitors the local data buffer disks and 
requests that files be stored in the mass storage system (ENSTORE). This 
request is made through the database interface (SAM) which negotiates the 
request for file storage with the ENSTORE system. 

All of the online computing systems are connected to a single high-capacity 
network switch. The architecture provides for parallel operation of multiple 
instances of the bandwidth-critical components. 

The high-level online software applications are predominately constructed us- 
ing the Python scripting language. Network communication between the com- 
ponents is implemented with the InterTask Communication (ITC) package, 
a multi-platform, multi-threaded client/server messaging system developed at 
Fermilab and based on the ACE [120] network and utility libary. 



11 Controls and monitoring 

The D0 experiment has extended EPICS (Experimental Physics and Indus- 
trial Control System) [121] to meet the control and monitoring requirements 
of a large high energy physics detector. EPICS, an integrated set of soft- 
ware building blocks for implementing a distributed control system, has been 
adapted to satisfy the slow controls needs of the detector by i) extending the 
support for new device types and an additional field bus, ii) the addition of a 
global event reporting system that augments the existing EPICS alarm sup- 
port, and in) the addition of a centralized database with supporting tools for 
defining the configuration of the control system. Figure 74 shows the architec- 
ture and components of the D0 controls and monitoring system. 

EPICS uses a distributed client-server architecture consisting of host-level 
nodes that run application programs (clients) and input/output controller 
(IOC) nodes (servers) that interface directly with the detector hardware. The 
two classes of nodes are connected by a local area network. Clients access 
process variable (PV) objects on the servers using the EPICS channel access 
protocol. 

One of the unique properties of the D0 detector interface is the use of the 
MIL-STD-1553B [56] serial bus for control and monitoring operations of the 
electronics components located in the collision hall. Since the detector is inac- 
cessible for extended periods of time, a robust, high-reliability communication 
field bus is essential. EPICS was extended by providing a queuing driver for 
MIL-STD-1553B controllers and a set of device support routines that provide 
the adaptive interface between the driver and the standard EPICS PV sup- 
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Fig. 74. Organization of the control system components. The Hosts are computers 
running Linux or Tru64 Unix and the lOCs arc embedded computers in VME crates. 
Only one IOC is shown, and only a few of the online hosts. 
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Fig. 75. The major components of the SES are the server, logger, watcher, and alarm 
display. COOR is a coordinating process that provides run control to the experiment. 
Significant events originate in the detector hardware, run control system, or online 
applications. 

port records. With these elements in place, all of the features of EPICS are 
available for use with D0's remote devices. 



11.1 Global event reporting 



To process significant events from all experiment sources, a separate facility, 
the significant event system (SES), collects and distributes all changes of state. 
The SES has a central server that collects event messages from sender clients 
and filters them, via a Boolean expression, for routing to receiving clients. 
Sender chents, including the lOCs, connect to the server and all state changes 
on those clients, including alarm transitions, are sent to the server. The archi- 
tecture of the SES and the flow of messages within the system are illustrated 
in Figure 75. 

The alarm class of SES messages receives special handhng in the server. The 
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SES server maintains the current alarm state of the entire experiment so that 
receiving chents can obtain the current state when they first connect to the 
server. In addition to speciahzed receiving chents that may connect to the 
server, there are three standard chents: the SES logger, the SES alarm display, 
and the SES alarm watcher. The logger has a pass-all filter so that it receives 
all SES messages sent to the server and writes the messages received to a disk 
file. The current state of the detector stored in the server is relayed to users 
through the alarm display. For alarms that compromise data quality, the alarm 
watcher automatically pauses the current run. In addition to its monitoring 
and logging functions, the SES system provides the means for distributing 
synchronizing messages to other components of the online software system. 
Tools have been developed for mining data from the SES log files. Hardware 
experts review the log files to understand which hardware devices are unstable 
and collaborators performing data analysis can be sure that the event they 
are examining is real and not caused by a fault in the detector. 



11.2 Centralized device database 



The EPICS databases that configure the individual lOCs are fiat ASCII files 
containing record definitions, the database equivalent of a PV, that are read by 
the lOCs during startup. The EPICS system additionally provides a higher- 
level construct, called a template, which is a parameterized collection of record 
definitions. Generator files, which reference the templates, supply the param- 
eter values to produce instances of these templated devices. While these col- 
lections of files are adequate for EPICS initialization, they are not easily ac- 
cessible to host-level processes, which require the same information. 

To address this problem, we have centralized the relevant information in a 
relational database (Oracle [122]) and provided a family of scripts to manage 
the transformation between the relational database and the EPICS ASCII- 
format files. At the time this document was prepared, the database contained 
approximately 6200 templated devices, corresponding to about 137000 process 
variables, and that number is constantly expanding. 

In addition to the database management scripts, a WWW browser interface 
to the relational database is available for the initial definition, modification, 
and viewing of the relational database entries. With control system device 
specifications centralized in the relational database, they are easily accessible 
to other host-level processes. 
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11.3 Detector configuration management 

One of the most complex tasks performed by the control system is the con- 
figuration of the detector for specific run conditions. The set of distinct con- 
figurations, both for physics data collection and for calibration runs, is very 
large; the usual technique of uploading a specific detector configuration and 
saving it as a file for subsequent downloading is impractical. 

For ease of configuration management, the detector is represented as a tree 
with nodes at successively deeper levels corresponding to smaller, more spe- 
cialized units of the detector. The terminal nodes of the tree, called action 
nodes, each manage the configuration of a specific, high-level device. They are 
instances of the high-level devices discussed in the preceding database section. 
The intermediate nodes of the tree primarily serve to organize the traversal 
order of the subordinate nodes since the detector is, in general, sensitive to 
the order in which devices are initialized. 

A single server program, COMICS, manages the configuration of the EPICS- 
accessible part of the detector. The tree nodes, both intermediate and action, 
are all specialized instances of a base node class that defines the majority of 
the methods that characterize node behavior. The detector tree structure is 
defined by a set of configuration files that are Python program segments that 
instantiate instances of these nodes. 

11.4 Operator interfaces and applications 

An application framework, in the Python scripting language, assists in de- 
veloping operator interfaces and provides a consistent "look and feel" for all 
visual displays. This framework includes a collection of specialized, graphical 
objects that construct updating displays of PV values using a Python inter- 
face to the EPICS channel access application program interface (APS). The 
experiment uses more than forty instances of these monitoring displays in the 
control room to manage the detector components. 

11.5 Archiving EPICS data 

While using EPICS records for control and monitoring tasks, almost every 

detector group needs to maintain structured access to archived PV values. 
There are two major archiving tools employed by D0: i) the channel archiver 
[123], for needs that require sampling rates of 1 Hz or faster, but do not 
require frequent access to historical data; and ii) the EPICS/Oracle Archiver, 
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for long-term studies that require slower sampling rates (once per minute or 
less frequently), easy access to data at any moment, and minimal maintenance. 

Many channel archivers are running concurrently, monitoring several thousand 
PVs. About once a week, collected archives are sent to the central Fermilab 
robotic tape storage via the SAM data management system (Section 12.6). 
The channel archiver toolset has interfaces, including web-based tools, that 
enable retrieval from an archive of data in different formats and generation of 
time plots with various options. 

11.6 ACNET gateway 

In the operation of the detector, it is vital to have a fast and reliable messaging 
connection between D0 and accelerator operations to exchange control and 
monitoring information. The D0 control system supplies cryogenic and mag- 
net data, the luminosity determined using the luminosity monitor (Section 8), 
as well as FPD pot positions and counter rates. The accelerator control sys- 
tem (ACNET), in turn, sends information about critical accelerator devices. 
A gateway between the D0 and ACNET control systems, based on the XML- 
RPC protocol [124] , provides this interconnection. 



12 Computing and software 

A large amount of software has been developed for data acquisition, monitoring 
and controlling hardware, Monte Carlo event simulation, and data and Monte 

Carlo event reconstruction. Early in the development of software for Run II, 
we made the decision that all new software would be written using the C-|--|- 
programming language. Legacy Run I Fortran software and programs from 
other sources (e.g. Monte Carlo event simulation programs) are wrapped in 
C-|— I- code. In this section, we give an overview of the computing and software 
in use during Run II. 

12.1 Event data model 

The D0 event data model (EDM) is a hbrary of C-|— I- classes and templates 
whose purpose is to support the implementation of reconstruction and analysis 
software. 

The central feature of the EDM is the event, a class that represents the results 
of a single beam crossing. The event acts as a container to manage all of the 
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Fig. 76. The structure of D0OM. The shaded area shows the components which are 
part of D0OM proper. 

data associated with a single crossing: the raw output of the detector, the 
results of trigger processing, and the results of many different reconstruction 
tasks. Each of the items in this collection contains both the data describing 
the crossing in question as well as metadata that describe the configuration 
of the program that constructed these results. This allows us to run multi- 
ple instances of single algorithms with different configuration information (for 
example, several cone-based jet algorithms with different cone radii), and to 
distinguish between the output of these different algorithms. The EDM also 
provides a mechanism for access to the collected reconstruction results, re- 
lieving the users from the burden of understanding the somewhat complex 
internal organization required for the management of the event data and the 
corresponding metadata. 



12.2 Data persistency 



The conversion of the C++ objects used in the reconstruction program to a 
persistent format is handled by the D0 object model (D0OM) [125]. This has 
several parts (Figure 76). First, D0OM maintains a dictionary describing the 
layout of the C++ classes that are to be used persistently, which is generated 
by running a preprocessor over the C++ headers defining the classes. This 
preprocessor is based on a modified version of the CINT C/C++ interpreter 
(which is also used in the ROOT system [126]). 

The actual translation between C++ objects and the persistent format is 
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handled by one of several I/O packages. User code has no dependence on 
the I/O packages, so that new formats can be added without changing any 
reconstruction code. The I/O packages are typically built on top of external 
software packages to do the actual I/O. 

Finally, the external interface to the package is provided by a set of stream 
classes. A set of D0 framework packages that use these classes to read and 
write events within the framework is also provided; in most framework 
user need only to include these packages to read and write events. 

DOOM includes numerous features to assist with schema evolution and ver- 
sioning of data. The dictionary information is maintained along with the saved 
data, so the layout of the saved data is always known. During reading, class 
members are matched between the C++ and persistent forms based on name. 
This allows D0OM to handle the common cases of adding and deleting data 
members with no explicit action on the part of the programmer. For more com- 
plicated cases, it is possible to provide conversion code that is automatically 
run when needed. The DOOM dictionary information may also be queried at 
run time. The system can also make use of the persistent dictionary infor- 
mation to build objects at run time for which no dictionary information was 
compiled into the program. This is useful for programs to dump or browse 
arbitrary DOOM data files. 

One I/O package is based on the DSPACK hbrary, which originated with the 
NA49 experiment [127]. DSPACK handles the conversion from C-like struc- 
tures to a serial data format; the DOOM I/O package converts from the C++ 
objects to the DSPACK structures. At DO, DSPACK data are usually encap- 
sulated inside another, lightweight, format called EVPACK, which provides 
data compression and random access within files with keyed lookup. EVPACK- 
encapsulated DSPACK records may also be sent over the network; this is used 
to distribute data within the online host system. All event data are stored in 
(EVPACK-encapsulated) DSPACK format. In addition, this format is Tised 
for several static, structured data files used by the reconstruction program, 
such as the description of the detector geometry. 



12.3 Calibration databases 

Run-dependent information needed for reconstruction, such as magnetic field 
polarities and calibration constants, is stored in a database. To decouple the 

reconstruction program from any particular proprietary database implementa- 
tion, DO makes use of a three-tier architecture [128], where the database and 
the client code make up the top and bottom tiers (Figure 77). In between is a 
middle tier server which accepts requests from the clients, makes the query to 
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Fig. 77. The hierachy of the database, middle tier server, and chent applications. 

Each server can cache data, and the servers can be chained to provide higher-speed 
access for clients located at remote processing sites. 

the database, and returns the data to the client. Data can be cached by the 
server, thus speeding up the response to the chent and reducing the load on 
the database. 

This caching is especially effective for the large-scale reconstruction of raw- 
data. If runs that require the same calibration constants are processed to- 
gether, only one query to the database is made for each calibration set; all 
other requests for this set are fulfilled directly from the cache. 

Servers can be chained together so that processing sites outside Fermilab may 

run their own local servers which request their data from the servers at the 
laboratory. This allows a remote processing site to have its own cache to speed 
up queries without requiring the site to access the database directly. 

The particular software used for storing the calibration data is the Oracle 
relational database. The middle tier servers are mostly implemented in the 
Python programming language with some parts written in C++ to improve 
performance. CORBA distributed object technology [129] is used for the com- 
munication between the client and the servers. The core part of the server 
is written to be independent of the particular application it is serving data 
for; the customized code which queries specific database tables and returns 
the results to the client is automatically generated from the database schema 
for each particular application. Each subsystem of the detector (SMT, CFT, 
preshower detectors, calorimeter, and muon detectors) has its own database 
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schema and a separate server. 

The chent end of the system is an 1/ O package for D0OM. The necessary C++ 
class definitions are also automatically generated from the database schema. 
Accessing the data is then a matter of navigating a C++ object hierarchy: the 
chent apphcation need have no knowledge of CORBA, Oracle, or the method 
by which it obtained the data. This decoupling makes it relatively easy to 
replace the specific implementation of the middle tier, if this becomes either 
necessary or desirable, without requiring the whole of the client implementa- 
tion to change. 

12.4 Event simulation 

The generation of Monte Carlo (MC) events involves multiple stages and many 
executables. To integrate all processes, all programs use the EDM to carry data 
in memory and D0OM to store persistent event data. All code is organized 
in independent packages running in a standard D0 framework and is written 
in C++ or embedded in C++ driving routines. 

The first step in MC event generation is the simulation of a physical process, 
a pp collision producing a particular final state. Nearly all existing event gen- 
erator programs are written in Fortran, but the StdHep code from the FNAL 
Computing Division can be used to store the output in a standard common 
block format. This allowed us to write a C++ wrapper that converts the 
StdHep Fortran format to C++ classes satisfying the EDM requirements. 

To trace the particles through the D0 detector, determine where their paths 
intersect active areas, and simulate their energy deposition and secondary 
interactions, we use the CERN program GEANT v3.21 [130], which is also 
written in Fortran. A C++ wrapper is used to read files produced by the 
event generators and to write the output of GEANT in D0OM format. This 
executable is called D0GSTAR. All subsequent steps in the event simulation 
are handled by programs written almost entirely in C++. 

The D0SIM program modifies the generated Monte Carlo data to account for 
various detector-related effects. After the particles from the simulated reaction 
have been traced through the detector, the generated energy depositions must 
be converted to the form that the real data takes when processed through 
the D0 electronics. Detector inefficiencies and noise (from the detector and 
electronic readout) must be taken into account, and more than one interaction 
may occur during a beam crossing. In addition, some portions of the detector 
(such as the calorimeter) remain sensitive to interactions over a period of 
time that includes more than one beam crossing. Simulation of the trigger 
electronics and the effects of the trigger on data selection is performed by 
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a separate program, D0TRIGSIM. D0TRIGSIM contains simulation code 
only for the LI trigger. The L2 and L3 triggers are based on filtering code, 
and exactly the same software runs in D0TRIGSIM. The output of D0SIM 
and D0TRIGSIM is in the same format as the data recorded by the D0 
data acquisition system, but contains additional MC information to make it 
possible to correlate detector data with the original generator output. 



12.5 Reconstruction 

The D0 offline reconstruction program D0RECO is responsible for recon- 
structing objects used for physics analysis. It is a CPU-intensive program that 
processes events recorded during data collection and simulated MC events. The 
executable is run on the offline production farms and the results are placed 
into the central data storage system (Section 12.6) for further analysis. Infor- 
mation and results for each event are organized using the EDM. The EDM 
manages information within the event in blocks called chunks. The raw data 
chunk (RDC), created either by an L3 processor node or the MC, contains 
the raw detector signals and is the primary input to D0RECO. The output 
from D0REGO consists of many additional chunks associated with each type 
of reconstructed object. 

D0RECO reconstructs events in several hierarchical steps. The first involves 
detector-specific processing. Detector unpackers process individual detector 
data blocks within the RDC, decoding the raw information, associating elec- 
tronics channels with physical detector elements, and applying detector-specific 
calibration constants. For many of the detectors, this information is then used 
to reconstruct cluster (for example, from the calorimeter and preshower detec- 
tors) or hit (from the tracking detectors) objects. These objects use geometry 
constants to associate detector elements (energies and positions) with physical 
positions in space. The second step in D0RECO focuses on the output of the 
tracking detectors, reconstructing global tracks from the hits in the SMT and 
GET. This process, involving several different tracking algorithms, is the most 
CPU-intensive activity of D0RECO. The results are stored in corresponding 
track chunks, which are used as input to the third step of D0RECO, vertex- 
ing. Eirst, primary vertex candidates are found. These vertices indicate the 
locations of pp interactions and are used in the calculation of various kine- 
matical quantities (e.g. Et). Next, displaced secondary vertex candidates are 
identified. Such vertices are associated with the decays of long-hved particles. 
The results of the above algorithms are stored in vertex chunks, and are then 
available for the final step of D0RECO — particle identification. Using a 
wide variety of algorithms, information from each of the preceding reconstruc- 
tion steps is combined and physics object candidates are created. RECO first 
finds electron, photon, muon, neutrino (^t), and jet candidates, after which 
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it identifies candidates for heavy-quark and tau decays. 



12.6 Data handling and storage 

The sequential access via metadata [131] (SAM) data handhng system gives 
users access to all the data created by the D0 experiment (both detector data 
and simulation data), in a flexible and transparent manner. The user does not 
need to know where the files arc physically stored, nor worry about exactly 
how they are dehvered to her/his process. SAM oversees the functions of cat- 
aloging data (files and events, and associated metadata regarding production 
conditions), transferring data in and out of mass storage systems, transfer- 
ring data among different computer systems (whether connected via local or 
wide area network), allocating and monitoring computing resources (batch 
slots, tape mounts, network bandwidth, disk cache space), and maintaining 
file delivery status at the user process level. The bookkeeping functions of the 
SAM system are provided by an Oracle [122] database, which is accessed via 
a client-server model utilizing CORBA technology. Files are stored in SAM 
using interfaces that require appropriate metadata for each file. The files are 
organized, according to the metadata provided, by data tier, and by produc- 
tion information (program version which produces the data, etc.). The SAM 
system also provides file storage, file delivery, and file caching protocols that 
permit the experiment to control and allocate the computing resources. Tape 
resources can be guaranteed to high priority activities (data acquisition and 
farm reconstruction), high usage files can be required to remain in the disk 
cache, and different priorities and allocations for resource usage can be granted 
to groups of users. 
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